Nov 05 14:55:21 devstack cinder-volume[76016]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 14:55:21 devstack cinder-volume[76016]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 14:55:21 devstack cinder-volume[76016]: we strongly recommend against using it for new projects. Nov 05 14:55:21 devstack cinder-volume[76016]: If you are already using Eventlet, we recommend migrating to a different Nov 05 14:55:21 devstack cinder-volume[76016]: framework. For more detail see Nov 05 14:55:21 devstack cinder-volume[76016]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 14:55:21 devstack cinder-volume[76016]: import eventlet # noqa Nov 05 14:55:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 14:55:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 14:55:24 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 14:55:25 devstack cinder-volume[76016]: INFO dbcounter [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Registered counter for database cinder Nov 05 14:55:25 devstack cinder-volume[76016]: DEBUG oslo_db.sqlalchemy.engines [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 14:55:25 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writer thread running {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 14:55:25 devstack cinder-volume[76016]: INFO cinder.rpc [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 14:55:25 devstack cinder-volume[76016]: INFO cinder.rpc [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 14:55:25 devstack cinder-volume[76016]: DEBUG oslo_db.sqlalchemy.engines [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 14:55:25 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Determined volume DB was empty at startup. Nov 05 14:55:25 devstack cinder-volume[76016]: DEBUG cinder.volume.manager [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76016) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 14:55:25 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 14:55:25 devstack cinder-volume[76016]: WARNING stevedore.named [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 14:55:25 devstack cinder-volume[76016]: WARNING castellan.key_manager [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 14:55:25 devstack cinder-volume[76016]: WARNING cinder.keymgr.conf_key_mgr [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG cinder.volume.drivers.lvm [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76016) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_concurrency.processutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.387s {{(pid=76016) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_db.sqlalchemy.engines [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 14:55:26 devstack cinder-volume[76016]: INFO cinder.rpc [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 14:55:26 devstack cinder-volume[76016]: INFO cinder.rpc [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 14:55:26 devstack cinder-volume[76016]: WARNING stevedore.named [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 14:55:26 devstack cinder-volume[76016]: WARNING castellan.key_manager [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 14:55:26 devstack cinder-volume[76016]: INFO cinder.volume.manager [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_db.sqlalchemy.engines [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 14:55:26 devstack cinder-volume[76016]: INFO oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Starting 1 workers Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Started child 76172 {{(pid=76016) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Full set of CONF: {{(pid=76016) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] ******************************************************************************** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 14:55:26 devstack cinder-volume[76172]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Configuration options gathered from: {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] ================================================================================ {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] allow_availability_zone_fallback = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] allow_compression_on_image_upload = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] allowed_direct_url_schemes = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] api_rate_limit = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] auth_strategy = keystone {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] az_cache_duration = 3600 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_availability_zone = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_host = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_stats_polling_interval = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backup_api_class = cinder.backup.api.API {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backup_name_template = backup-%s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backup_use_same_host = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backup_use_temp_snapshot = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] chap_password = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] chap_username = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_internal_tenant_project_id = f302c4ade9b948138e01aff32b85cade {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_internal_tenant_user_id = 42719820f13c4e828ab04744fc4d0167 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cloned_volume_same_az = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cluster = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] compression_format = gzip {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] compute_api_class = cinder.compute.nova.API {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] config_dir = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] config_source = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] control_exchange = openstack {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] debug = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] default_availability_zone = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] default_group_type = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] default_volume_type = lvmdriver-1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] disk_geometry = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] driver_client_cert = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] driver_client_cert_key = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] driver_data_namespace = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] driver_ssl_cert_path = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] driver_ssl_cert_verify = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] driver_use_ssl = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] enable_force_upload = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] enable_new_services = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] enable_unsupported_driver = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] enforce_multipath_for_image_xfer = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] filter_function = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_api_insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_api_ssl_compression = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_ca_certificates_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_catalog_info = image:glance:publicURL {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_num_retries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance_request_timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] goodness_function = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] graceful_shutdown_timeout = 5 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] group_api_class = cinder.group.api.API {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] host = devstack {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_compress_on_upload = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_conversion_address_space_limit = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_conversion_cpu_limit = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_conversion_disable = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_introspection_address_space_limit = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_introspection_cpu_limit = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_upload_use_cinder_backend = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_upload_use_internal_tenant = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_volume_cache_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_volume_cache_max_count = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] image_volume_cache_max_size_gb = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] init_host_max_objects_retrieval = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] instance_format = [instance: %(uuid)s] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] iscsi_target_flags = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] iscsi_write_cache = on {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] iser_helper = tgtadm {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] iser_ip_address = 192.168.122.60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] iser_port = 3260 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_color = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_config_append = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_dir = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_options = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_rotate_interval = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_rotate_interval_type = days {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] log_rotation_type = none {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] max_age = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] max_logfile_count = 30 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] max_logfile_size_mb = 200 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] max_over_subscription_ratio = 20.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] message_reap_interval = 86400 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] message_ttl = 2592000 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] migration_create_volume_timeout_secs = 300 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] monkey_patch = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] monkey_patch_modules = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] my_ip = 192.168.122.60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] no_snapshot_gb_quota = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] num_iser_scan_tries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] num_shell_tries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] num_volume_device_scan_tries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] nvmeof_conn_info_version = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] nvmet_ns_id = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] nvmet_port_id = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_max_limit = 1000 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_volume_ext_list = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_volume_listen_port = 8776 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_volume_use_ssl = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] osapi_volume_workers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] per_volume_size_limit = -1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] periodic_fuzzy_delay = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] periodic_interval = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] public_endpoint = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] publish_errors = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_backup_gigabytes = 1000 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_backups = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_gigabytes = 1000 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_groups = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_snapshots = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] quota_volumes = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] rate_limit_burst = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] rate_limit_except_level = CRITICAL {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] rate_limit_interval = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] reinit_driver_count = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] replication_device = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] report_discard_supported = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] report_interval = 120 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] reservation_clean_interval = 86400 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] reservation_expire = 86400 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] reserved_image_namespaces = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] reserved_percentage = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] rpc_response_timeout = 120 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] run_external_periodic_tasks = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] scst_target_driver = iscsi {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] scst_target_iqn_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_down_time = 720 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] shell_completion = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] snapshot_name_template = snapshot-%s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] snapshot_same_host = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] split_loggers = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] state_path = /opt/stack/data/cinder {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] storage_availability_zone = nova {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] storage_protocol = iSCSI {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] syslog_log_facility = LOG_USER {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] target_helper = lioadm {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] target_ip_address = 192.168.122.60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] target_port = 3260 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] target_protocol = iscsi {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] target_secondary_ip_addresses = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] trace_flags = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] transport_url = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] until_refresh = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_chap_auth = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_default_quota_class = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_journal = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_json = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_multipath_for_image_xfer = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_stderr = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] use_syslog = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] verify_glance_signatures = enabled {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_api_class = cinder.volume.api.API {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_backend_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_clear = zero {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_clear_ionice = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_clear_size = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_copy_bps_limit = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_dd_blocksize = 1M {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:26 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_name_template = volume-%s {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_service_inithost_offload = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volume_usage_audit_period = month {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] zoning_mode = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.auth_section = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.auth_type = password {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.auth_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.cache = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.include_service_catalog = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.interface = public {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_password = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack sudo[76176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 14:55:26 devstack sudo[76176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcache_username = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.region_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.service_type = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.60/identity {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.backend = dogpile.cache.null {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.backend_argument = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.backend_expiration_time = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.config_prefix = cache.oslo {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.debug_cache_backend = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.enable_retry_client = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.enable_socket_keepalive = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.expiration_time = 600 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_dead_retry = 300 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_pool_maxsize = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_sasl_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.password = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.proxies = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.redis_db = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.redis_server = localhost:6379 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.retry_attempts = 2 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.retry_delay = 0.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.socket_keepalive_count = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.socket_keepalive_idle = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.socket_keepalive_interval = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.socket_timeout = 1.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.tls_allowed_ciphers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.tls_cafile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.tls_certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.tls_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.tls_keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cache.username = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] coordination.backend_url = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.asyncio_connection = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.asyncio_slave_connection = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.backend = sqlalchemy {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.connection = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.connection_debug = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.connection_parameters = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.connection_recycle_time = 3600 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.connection_trace = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.db_inc_retry_interval = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.db_max_retries = 20 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.db_max_retry_interval = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.db_retry_interval = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.max_overflow = 50 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.max_pool_size = 5 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.max_retries = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.pool_timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.retry_interval = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.slave_connection = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.sqlite_synchronous = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.synchronous_reader = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] database.use_db_reconnect = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_tracing.insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.connection_string = messaging:// {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.es_doc_type = notification {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.es_scroll_size = 10000 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.es_scroll_time = 2m {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.filter_error_trace = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.hmac_keys = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.sentinel_service_name = mymaster {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.socket_timeout = 0.1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.trace_requests = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler.trace_sqlalchemy = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler_jaeger.process_tags = {} {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] profiler_otlp.service_name_prefix = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.enforce_new_defaults = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.policy_default_rule = default {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.policy_file = policy.yaml {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.group = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.helper_command = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] privsep_osbrick.user = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.group = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.helper_command = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] cinder_sys_admin.user = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.auth_section = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.auth_type = password {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.cafile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.collect_timing = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.send_service_user_token = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.split_loggers = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.tls_ciphers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] service_user.tls_min_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.auth_section = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.auth_type = password {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.collect_timing = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.region_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.split_loggers = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.tls_ciphers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] glance.tls_min_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.backend_availability_zone = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.chap_password = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.chap_username = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.disk_geometry = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.driver_client_cert = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.driver_client_cert_key = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.driver_data_namespace = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.driver_use_ssl = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.extra_capabilities = {} {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.filter_function = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.goodness_function = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.iscsi_target_flags = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.iscsi_write_cache = on {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.iser_helper = tgtadm {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.iser_port = 3260 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.lvm_share_target = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.lvm_type = auto {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.num_shell_tries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.replication_device = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.report_discard_supported = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.reserved_percentage = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.target_helper = tgtadm {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.target_port = 3260 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.target_protocol = iscsi {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.trace_flags = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.unique_fqdn_network = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.use_chap_auth = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_backend_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_clear = zero {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_clear_ionice = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_clear_size = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_reports.file_event_handler = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_reports.log_dir = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.backend_host = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.chap_password = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.chap_username = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.disk_geometry = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.driver_client_cert = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.extra_capabilities = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.filter_function = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.goodness_function = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.iser_helper = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.iser_ip_address = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.iser_port = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.lvm_share_target = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.lvm_type = auto {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.num_shell_tries = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.replication_device = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.report_discard_supported = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.reserved_percentage = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.scst_target_driver = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.storage_protocol = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.target_helper = lioadm {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.target_ip_address = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.target_port = 3260 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.trace_flags = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.use_chap_auth = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_clear = zero {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_clear_size = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:26 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] lvmdriver-1.volumes_dir = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_notifications.driver = [] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] key_manager.fixed_key = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.barbican_api_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.barbican_endpoint = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.barbican_endpoint_type = public {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.barbican_region_name = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.cafile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.collect_timing = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.number_of_retries = 60 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.retry_delay = 1 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.send_service_user_token = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.split_loggers = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.tls_ciphers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.tls_min_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.verify_ssl = True {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican.verify_ssl_path = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.auth_section = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.auth_type = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.cafile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.certfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.collect_timing = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.insecure = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.keyfile = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.split_loggers = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.timeout = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.tls_ciphers = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] barbican_service_user.tls_min_version = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.approle_role_id = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.approle_secret_id = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.auth_method = approle {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.auth_path = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.kv_mountpoint = secret {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.kv_path = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.kv_version = 2 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.namespace = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.root_token_id = **** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.ssl_ca_crt_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.timeout = 60.0 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.token_file = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.token_role = None {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.use_ssl = False {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 14:55:27 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] ******************************************************************************** {{(pid=76016) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 14:55:27 devstack sudo[76176]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:27 devstack sudo[76182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:27 devstack sudo[76182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:27 devstack sudo[76182]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.273s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 14:55:27 devstack cinder-volume[76172]: INFO cinder.brick.local_dev.lvm [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:27 devstack sudo[76341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:55:27 devstack sudo[76341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:27 devstack sudo[76341]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG cinder.brick.local_dev.lvm [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76172) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 14:55:27 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:27 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:27 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:28 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.569s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:28 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:28 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:28 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:28 devstack sudo[76690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 14:55:28 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:28 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.348s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:28 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:29 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:55:29 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:29 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:29 devstack sudo[76794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:55:29 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:29 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:29 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:29 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:29 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:29 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:29 devstack sudo[76888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:29 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:30 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.339s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:30 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:30 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:30 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:30 devstack cinder-volume[76172]: INFO cinder.volume.drivers.lvm [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:30 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:30 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:30 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:55:30 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:30 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:55:30 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:31 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:31 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:31 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:31 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:31 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:31 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:31 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:31 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:31 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:31 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:31 devstack cinder-volume[76172]: INFO cinder.volume.driver [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 14:55:31 devstack cinder-volume[76172]: DEBUG cinder.volume.driver [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76172) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_db.sqlalchemy.engines [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76172) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writer thread running {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG cinder.db.api [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Building query based on filter {{(pid=76172) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG cinder.image.image_utils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76172) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 14:55:32 devstack cinder-volume[76172]: INFO cinder.keymgr.migration [None req-5044549b-c6be-491d-9315-317ec46abc2e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:32 devstack sudo[76997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:55:32 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:32 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:32 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:32 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:32 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:32 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:32 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:32 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:32 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:32 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:32 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:33 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 14:55:33 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Driver initialization completed successfully. Nov 05 14:55:33 devstack cinder-volume[76172]: INFO cinder.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Initiating service 2 cleanup Nov 05 14:55:33 devstack cinder-volume[76172]: INFO cinder.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Service 2 cleanup completed. Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG cinder.service [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Creating RPC server for service cinder-volume {{(pid=76172) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG cinder.service [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76172) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 14:55:33 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:33 devstack sudo[77011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:55:33 devstack sudo[77011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:33 devstack sudo[77011]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:33 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:33 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:33 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:33 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:33 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:55:33 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:34 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:55:34 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:55:34 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:55:34 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Nov 05 14:55:34 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:55:34 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-91f5b471-4401-4e28-98ab-b55b7b1a60a9 None None] Driver post RPC initialization completed successfully. Nov 05 14:55:36 devstack cinder-volume[76016]: DEBUG dbcounter [-] [76016] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76016) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 14:55:44 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 14:55:44 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 14:55:45 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:55:45 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 14:55:45 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread info: [<_MainThread(MainThread, started 137978510127232)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 14:56:45 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:56:45 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:56:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:56:45 devstack sudo[79528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:56:45 devstack sudo[79528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:56:45 devstack sudo[79528]: pam_unix(sudo:session): session closed for user root Nov 05 14:56:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:56:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:56:45 devstack sudo[79531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:56:45 devstack sudo[79531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:56:46 devstack sudo[79531]: pam_unix(sudo:session): session closed for user root Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:56:46 devstack sudo[79534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:56:46 devstack sudo[79534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:56:46 devstack sudo[79534]: pam_unix(sudo:session): session closed for user root Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:56:46 devstack sudo[79538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:56:46 devstack sudo[79538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:56:46 devstack sudo[79538]: pam_unix(sudo:session): session closed for user root Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 14:56:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread info: [<_MainThread(MainThread, started 137978510127232)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 14:57:44 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 14:57:44 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 14:57:45 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:57:45 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:57:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:57:45 devstack sudo[82544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:57:45 devstack sudo[82544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:57:45 devstack sudo[82544]: pam_unix(sudo:session): session closed for user root Nov 05 14:57:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:57:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:57:45 devstack sudo[82549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:57:45 devstack sudo[82549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:57:46 devstack sudo[82549]: pam_unix(sudo:session): session closed for user root Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:57:46 devstack sudo[82555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:57:46 devstack sudo[82555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:57:46 devstack sudo[82555]: pam_unix(sudo:session): session closed for user root Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:57:46 devstack sudo[82560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:57:46 devstack sudo[82560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:57:46 devstack sudo[82560]: pam_unix(sudo:session): session closed for user root Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 14:57:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread info: [<_MainThread(MainThread, started 137978510127232)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 14:58:45 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:58:45 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:58:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:58:45 devstack sudo[84698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:58:45 devstack sudo[84698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:58:45 devstack sudo[84698]: pam_unix(sudo:session): session closed for user root Nov 05 14:58:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:58:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:58:45 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:58:45 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:58:46 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:58:46 devstack sudo[84715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:58:46 devstack sudo[84715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:58:46 devstack sudo[84715]: pam_unix(sudo:session): session closed for user root Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:58:46 devstack sudo[84728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:58:46 devstack sudo[84728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:58:46 devstack sudo[84728]: pam_unix(sudo:session): session closed for user root Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 14:58:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread info: [<_MainThread(MainThread, started 137978510127232)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 14:59:44 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 14:59:45 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:59:45 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 14:59:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:59:45 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 14:59:45 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:59:45 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Nov 05 14:59:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:59:45 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:59:45 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:59:45 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:59:46 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:59:46 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 14:59:46 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:59:46 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 14:59:46 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 14:59:46 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 14:59:46 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 14:59:46 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-4f56ee55-cdcd-4361-804d-1b763c36feb0 None None] thread info: [<_MainThread(MainThread, started 137978510127232)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 14:59:55 devstack cinder-volume[76016]: INFO oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Caught SIGTERM, stopping children Nov 05 14:59:55 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Acquiring lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 14:59:55 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Acquired lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 14:59:55 devstack cinder-volume[76016]: DEBUG oslo_concurrency.lockutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Releasing lock "singleton_lock" {{(pid=76016) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 14:59:55 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Stop services. {{(pid=76016) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 14:59:55 devstack cinder-volume[76016]: DEBUG oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Killing children. {{(pid=76016) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 14:59:55 devstack cinder-volume[76016]: INFO oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Waiting on 1 children to exit Nov 05 14:59:58 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Acquiring lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 14:59:58 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Acquired lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 14:59:58 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Releasing lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 14:59:58 devstack cinder-volume[76172]: WARNING amqp [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 14:59:58 devstack cinder-volume[76172]: WARNING amqp [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 14:59:58 devstack cinder-volume[76016]: INFO oslo_service.backend._eventlet.service [None req-ade568f9-3b4f-4c02-9af6-162bbbe981f5 None None] Child 76172 exited with status 0 Nov 05 14:59:58 devstack cinder-volume[86222]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 14:59:58 devstack cinder-volume[86222]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 14:59:58 devstack cinder-volume[86222]: we strongly recommend against using it for new projects. Nov 05 14:59:58 devstack cinder-volume[86222]: If you are already using Eventlet, we recommend migrating to a different Nov 05 14:59:58 devstack cinder-volume[86222]: framework. For more detail see Nov 05 14:59:58 devstack cinder-volume[86222]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 14:59:58 devstack cinder-volume[86222]: import eventlet # noqa Nov 05 15:00:00 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 15:00:00 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 15:00:00 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 15:00:01 devstack cinder-volume[86222]: INFO dbcounter [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Registered counter for database cinder Nov 05 15:00:01 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:01 devstack cinder-volume[86222]: DEBUG dbcounter [-] [86222] Writer thread running {{(pid=86222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 15:00:01 devstack cinder-volume[86222]: INFO cinder.rpc [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 15:00:01 devstack cinder-volume[86222]: INFO cinder.rpc [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 15:00:01 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:02 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Determined volume DB was empty at startup. Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG cinder.volume.manager [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86222) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 15:00:02 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 15:00:02 devstack cinder-volume[86222]: WARNING stevedore.named [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 15:00:02 devstack cinder-volume[86222]: WARNING castellan.key_manager [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 15:00:02 devstack cinder-volume[86222]: WARNING cinder.keymgr.conf_key_mgr [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 15:00:02 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:02 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Starting 1 workers Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Started child 86441 {{(pid=86222) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Full set of CONF: {{(pid=86222) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] ******************************************************************************** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Configuration options gathered from: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] ================================================================================ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] allow_availability_zone_fallback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] allow_compression_on_image_upload = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] allowed_direct_url_schemes = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] api_rate_limit = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] auth_strategy = keystone {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_stats_polling_interval = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backup_api_class = cinder.backup.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86441]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backup_name_template = backup-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backup_use_same_host = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backup_use_temp_snapshot = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] chap_username = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_internal_tenant_project_id = f302c4ade9b948138e01aff32b85cade {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_internal_tenant_user_id = 42719820f13c4e828ab04744fc4d0167 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cluster = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] compression_format = gzip {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] compute_api_class = cinder.compute.nova.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] config_dir = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] config_source = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] control_exchange = openstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] debug = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] default_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] default_group_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] default_volume_type = QuobyteHD {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] driver_ssl_cert_verify = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] driver_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] enable_new_services = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] enable_unsupported_driver = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] enabled_backends = ['QuobyteHD'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] enforce_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_api_insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_api_ssl_compression = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_ca_certificates_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_catalog_info = image:glance:publicURL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_num_retries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance_request_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] graceful_shutdown_timeout = 5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] group_api_class = cinder.group.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] host = devstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_compress_on_upload = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_conversion_address_space_limit = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_conversion_cpu_limit = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_conversion_disable = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_introspection_address_space_limit = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_introspection_cpu_limit = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_upload_use_cinder_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_upload_use_internal_tenant = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_volume_cache_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_volume_cache_max_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] image_volume_cache_max_size_gb = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] init_host_max_objects_retrieval = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] instance_format = [instance: %(uuid)s] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] iscsi_target_flags = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] iscsi_write_cache = on {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] iser_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] iser_ip_address = 192.168.122.60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] iser_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_color = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_config_append = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_options = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_rotate_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_rotate_interval_type = days {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] log_rotation_type = none {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] max_age = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] max_logfile_count = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] max_logfile_size_mb = 200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] max_over_subscription_ratio = 20.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] message_reap_interval = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] message_ttl = 2592000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] migration_create_volume_timeout_secs = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] monkey_patch = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] monkey_patch_modules = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] my_ip = 192.168.122.60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] no_snapshot_gb_quota = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] num_iser_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] num_shell_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] num_volume_device_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] nvmeof_conn_info_version = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] nvmet_ns_id = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] nvmet_port_id = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_max_limit = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_volume_ext_list = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_volume_listen_port = 8776 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_volume_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] osapi_volume_workers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] per_volume_size_limit = -1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] periodic_fuzzy_delay = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] periodic_interval = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] public_endpoint = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] publish_errors = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_backup_gigabytes = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_backups = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_gigabytes = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_groups = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_snapshots = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] quota_volumes = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] rate_limit_burst = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] rate_limit_except_level = CRITICAL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] rate_limit_interval = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] reinit_driver_count = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] report_discard_supported = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] report_interval = 120 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] reservation_clean_interval = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] reservation_expire = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] reserved_image_namespaces = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] reserved_percentage = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] rpc_response_timeout = 120 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] run_external_periodic_tasks = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] scst_target_driver = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_down_time = 720 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] shell_completion = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] snapshot_name_template = snapshot-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] state_path = /opt/stack/data/cinder {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] storage_availability_zone = nova {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] storage_protocol = iSCSI {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] syslog_log_facility = LOG_USER {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] target_helper = lioadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] target_ip_address = 192.168.122.60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] target_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] target_protocol = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] target_secondary_ip_addresses = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] transport_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] until_refresh = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_chap_auth = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_default_quota_class = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_journal = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_json = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_stderr = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] use_syslog = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] verify_glance_signatures = enabled {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_api_class = cinder.volume.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_clear = zero {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_clear_size = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_copy_bps_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_dd_blocksize = 1M {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_name_template = volume-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_service_inithost_offload = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volume_usage_audit_period = month {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.remotefs [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86441) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] zoning_mode = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_concurrency.disable_process_locking = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.auth_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.include_service_catalog = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.interface = public {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcache_username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.service_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.60/identity {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.backend = dogpile.cache.null {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.backend_argument = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.backend_expiration_time = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.config_prefix = cache.oslo {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.debug_cache_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.enable_retry_client = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.enable_socket_keepalive = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.expiration_time = 600 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.hashclient_retry_attempts = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_dead_retry = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_pool_maxsize = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_sasl_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.proxies = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.redis_db = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.redis_server = localhost:6379 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.retry_attempts = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.retry_delay = 0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.socket_keepalive_count = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.socket_keepalive_idle = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.socket_keepalive_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.socket_timeout = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.tls_allowed_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.tls_cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.tls_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.tls_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.tls_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cache.username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] coordination.backend_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.asyncio_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.asyncio_slave_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.backend = sqlalchemy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.connection_debug = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.connection_parameters = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.connection_recycle_time = 3600 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.connection_trace = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.db_inc_retry_interval = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.db_max_retries = 20 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.db_max_retry_interval = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.db_retry_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.max_overflow = 50 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.max_pool_size = 5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.max_retries = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.mysql_wsrep_sync_wait = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.pool_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.retry_interval = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.slave_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.sqlite_synchronous = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.synchronous_reader = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] database.use_db_reconnect = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_tracing.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.connection_string = messaging:// {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.es_doc_type = notification {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.es_scroll_size = 10000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.es_scroll_time = 2m {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.filter_error_trace = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.hmac_keys = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.sentinel_service_name = mymaster {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.socket_timeout = 0.1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.trace_requests = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler.trace_sqlalchemy = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler_jaeger.process_tags = {} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler_jaeger.service_name_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] profiler_otlp.service_name_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.enforce_new_defaults = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.policy_default_rule = default {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.policy_file = policy.yaml {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.group = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.helper_command = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] privsep_osbrick.user = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.group = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.helper_command = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] cinder_sys_admin.user = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.send_service_user_token = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] service_user.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86441) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 15:00:02 devstack cinder-volume[86441]: WARNING cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 15:00:02 devstack cinder-volume[86441]: WARNING cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Running cmd (subprocess): mount.quobyte {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] glance.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.chap_username = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.driver_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.extra_capabilities = {} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.iscsi_target_flags = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.iscsi_write_cache = on {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.iser_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.iser_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_host = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_login = admin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_mount_options = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_private_key = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_share_path = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.num_shell_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.quobyte_volume_url = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.report_discard_supported = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.reserved_percentage = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.target_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.target_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.target_protocol = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.unique_fqdn_network = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.use_chap_auth = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_clear = zero {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_clear_size = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_reports.file_event_handler = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_reports.log_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.backend_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.chap_username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.chiscsi_conf = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.driver_use_ssl = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.extra_capabilities = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.iser_helper = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.iser_ip_address = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.iser_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.iser_target_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_login = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_mount_options = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_private_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_share_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_ssh_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.num_shell_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.nvmet_port_id = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86441]: INFO cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d ... Nov 05 15:00:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 -c /etc/quobyte/client-cinder.cfg {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.report_discard_supported = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.reserved_percentage = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.scst_target_driver = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.storage_protocol = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.target_helper = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.target_ip_address = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.target_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.target_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.target_protocol = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.use_chap_auth = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_clear = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_clear_size = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] QuobyteHD.volumes_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_notifications.driver = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_notifications.retry = -1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] key_manager.fixed_key = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.barbican_api_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.barbican_endpoint = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.barbican_endpoint_type = public {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.barbican_region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.number_of_retries = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.retry_delay = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.send_service_user_token = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 -c /etc/quobyte/client-cinder.cfg Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.verify_ssl = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican.verify_ssl_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.auth_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] barbican_service_user.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.approle_role_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.approle_secret_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.auth_method = approle {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.auth_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.kv_mountpoint = secret {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.kv_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.kv_version = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.root_token_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.ssl_ca_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.token_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.token_role = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:02 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] ******************************************************************************** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 15:00:02 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.472s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d succeeded Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.485s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:03 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:03 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:03 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.249s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.volume.driver [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.volume.driver [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86441) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_db.sqlalchemy.engines [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG dbcounter [-] [86441] Writer thread running {{(pid=86441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.db.api [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Building query based on filter {{(pid=86441) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.image.image_utils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86441) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.keymgr.migration [None req-af9d7a12-edac-46e4-87e3-98c24b7ab7e2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:03 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:03 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:03 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.232s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Notifying Schedulers of capabilities ... {{(pid=86441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Driver initialization completed successfully. Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Initiating service 3 cleanup Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Service 3 cleanup completed. Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.service [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Creating RPC server for service cinder-volume {{(pid=86441) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.service [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86441) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 15:00:03 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:03 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:03 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:03 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:04 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:04 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.253s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:04 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-55e43c04-5dc1-409c-a65d-e48ac74c0578 None None] Driver post RPC initialization completed successfully. Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:08 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:08 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:08 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.252s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:08 devstack cinder-volume[86441]: DEBUG cinder.manager [None req-caa65874-9b96-43ef-ad17-798383051b0c None None] Notifying Schedulers of capabilities ... {{(pid=86441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:00:09 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Caught SIGTERM, stopping children Nov 05 15:00:09 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Acquiring lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 15:00:09 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Acquired lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 15:00:09 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Releasing lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 15:00:09 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Stop services. {{(pid=86222) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 15:00:09 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Killing children. {{(pid=86222) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 15:00:09 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Waiting on 1 children to exit Nov 05 15:00:12 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Acquiring lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 15:00:12 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Acquired lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 15:00:12 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Releasing lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 15:00:12 devstack cinder-volume[86441]: WARNING amqp [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 15:00:12 devstack cinder-volume[86441]: WARNING amqp [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 15:00:12 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-3ae717b3-5725-40b0-9029-cb51abdeede9 None None] Child 86441 exited with status 0 Nov 05 15:00:12 devstack cinder-volume[86791]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 15:00:12 devstack cinder-volume[86791]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 15:00:12 devstack cinder-volume[86791]: we strongly recommend against using it for new projects. Nov 05 15:00:12 devstack cinder-volume[86791]: If you are already using Eventlet, we recommend migrating to a different Nov 05 15:00:12 devstack cinder-volume[86791]: framework. For more detail see Nov 05 15:00:12 devstack cinder-volume[86791]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 15:00:12 devstack cinder-volume[86791]: import eventlet # noqa Nov 05 15:00:15 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 15:00:15 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 15:00:15 devstack cinder-volume[86791]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 15:00:16 devstack cinder-volume[86791]: INFO dbcounter [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Registered counter for database cinder Nov 05 15:00:16 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG dbcounter [-] [86791] Writer thread running {{(pid=86791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 15:00:17 devstack cinder-volume[86791]: INFO cinder.rpc [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 15:00:17 devstack cinder-volume[86791]: INFO cinder.rpc [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:17 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Determined volume DB was empty at startup. Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG cinder.volume.manager [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86791) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 15:00:17 devstack cinder-volume[86791]: WARNING stevedore.named [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 15:00:17 devstack cinder-volume[86791]: WARNING castellan.key_manager [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 15:00:17 devstack cinder-volume[86791]: WARNING cinder.keymgr.conf_key_mgr [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 15:00:17 devstack cinder-volume[86791]: INFO cinder.volume.manager [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_db.sqlalchemy.engines [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:17 devstack cinder-volume[86791]: INFO oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Starting 1 workers Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Started child 87126 {{(pid=86791) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Full set of CONF: {{(pid=86791) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] ******************************************************************************** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] Configuration options gathered from: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] ================================================================================ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] allow_availability_zone_fallback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] allow_compression_on_image_upload = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] allowed_direct_url_schemes = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] api_rate_limit = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] auth_strategy = keystone {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_host = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_stats_polling_interval = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backup_api_class = cinder.backup.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backup_name_template = backup-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backup_use_same_host = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backup_use_temp_snapshot = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] chap_username = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[87126]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_internal_tenant_project_id = f302c4ade9b948138e01aff32b85cade {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_internal_tenant_user_id = 42719820f13c4e828ab04744fc4d0167 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cluster = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] compression_format = gzip {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] compute_api_class = cinder.compute.nova.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] config_dir = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] config_source = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] control_exchange = openstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] debug = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] default_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] default_group_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] default_volume_type = QuobyteHD {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] driver_ssl_cert_verify = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] driver_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] enable_new_services = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] enable_unsupported_driver = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] enabled_backends = ['QuobyteHD'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] enforce_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_api_insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_api_ssl_compression = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_ca_certificates_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_catalog_info = image:glance:publicURL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_num_retries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance_request_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] graceful_shutdown_timeout = 5 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] group_api_class = cinder.group.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] host = devstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_compress_on_upload = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_conversion_address_space_limit = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_conversion_cpu_limit = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_conversion_disable = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_introspection_address_space_limit = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_introspection_cpu_limit = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_upload_use_cinder_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_upload_use_internal_tenant = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_volume_cache_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_volume_cache_max_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] init_host_max_objects_retrieval = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] instance_format = [instance: %(uuid)s] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] iscsi_target_flags = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] iscsi_write_cache = on {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] iser_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] iser_ip_address = 192.168.122.60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] iser_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_color = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_config_append = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_dir = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_options = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_rotate_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_rotate_interval_type = days {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] log_rotation_type = none {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] max_age = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] max_logfile_count = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] max_logfile_size_mb = 200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] max_over_subscription_ratio = 20.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] message_reap_interval = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] message_ttl = 2592000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] monkey_patch = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] monkey_patch_modules = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] my_ip = 192.168.122.60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] no_snapshot_gb_quota = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] num_iser_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] num_shell_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] num_volume_device_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] nvmeof_conn_info_version = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] nvmet_ns_id = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] nvmet_port_id = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_max_limit = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_volume_ext_list = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_volume_listen_port = 8776 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_volume_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] osapi_volume_workers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] per_volume_size_limit = -1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] periodic_fuzzy_delay = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] periodic_interval = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] public_endpoint = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] publish_errors = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_backup_gigabytes = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_backups = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_gigabytes = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_groups = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_snapshots = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] quota_volumes = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] rate_limit_burst = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] rate_limit_except_level = CRITICAL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] rate_limit_interval = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] reinit_driver_count = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] report_discard_supported = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] report_interval = 120 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] reservation_clean_interval = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] reservation_expire = 86400 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] reserved_image_namespaces = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] reserved_percentage = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] rpc_response_timeout = 120 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87126) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] run_external_periodic_tasks = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] scst_target_driver = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_down_time = 720 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] shell_completion = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] snapshot_name_template = snapshot-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] state_path = /opt/stack/data/cinder {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] storage_availability_zone = nova {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] storage_protocol = iSCSI {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] syslog_log_facility = LOG_USER {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] target_helper = lioadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] target_ip_address = 192.168.122.60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] target_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] target_protocol = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] target_secondary_ip_addresses = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] trace_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] transport_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] until_refresh = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_chap_auth = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_default_quota_class = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_journal = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_json = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_stderr = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] use_syslog = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] verify_glance_signatures = enabled {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_api_class = cinder.volume.api.API {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_clear = zero {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_clear_size = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_copy_bps_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_dd_blocksize = 1M {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_name_template = volume-%s {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_service_inithost_offload = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volume_usage_audit_period = month {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] zoning_mode = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.auth_type = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.auth_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.interface = public {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcache_username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.service_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.60/identity {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.backend = dogpile.cache.null {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.backend_argument = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.backend_expiration_time = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.config_prefix = cache.oslo {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.debug_cache_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.enable_retry_client = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.enable_socket_keepalive = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.expiration_time = 600 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_dead_retry = 300 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_pool_maxsize = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_sasl_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.proxies = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.redis_db = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.redis_server = localhost:6379 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.retry_attempts = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.retry_delay = 0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.socket_keepalive_count = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.socket_keepalive_idle = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.socket_keepalive_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.socket_timeout = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.tls_allowed_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.tls_cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.tls_certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.tls_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.tls_keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cache.username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] coordination.backend_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.asyncio_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.asyncio_slave_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.backend = sqlalchemy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.connection_debug = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.connection_parameters = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.connection_recycle_time = 3600 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.connection_trace = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.db_inc_retry_interval = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.db_max_retries = 20 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.db_max_retry_interval = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.db_retry_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.max_overflow = 50 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.max_pool_size = 5 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.max_retries = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.pool_timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.retry_interval = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.slave_connection = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.sqlite_synchronous = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.synchronous_reader = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] database.use_db_reconnect = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_tracing.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.connection_string = messaging:// {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.es_doc_type = notification {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.es_scroll_size = 10000 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.es_scroll_time = 2m {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.filter_error_trace = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.hmac_keys = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.sentinel_service_name = mymaster {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.socket_timeout = 0.1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.trace_requests = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler.trace_sqlalchemy = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler_jaeger.process_tags = {} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] profiler_otlp.service_name_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.policy_default_rule = default {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.policy_file = policy.yaml {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.group = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.helper_command = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] privsep_osbrick.user = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.group = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.helper_command = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] cinder_sys_admin.user = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.auth_type = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.send_service_user_token = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] service_user.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.auth_type = password {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] glance.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.chap_username = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.driver_use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.extra_capabilities = {} {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.iscsi_target_flags = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.iser_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.iser_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_host = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_login = admin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_mount_options = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_private_key = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_share_path = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.report_discard_supported = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87126) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.target_helper = tgtadm {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.target_port = 3260 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.target_protocol = iscsi {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.trace_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.use_chap_auth = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_backend_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_clear = zero {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_reports.file_event_handler = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_reports.log_dir = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.backend_host = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.chap_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.chap_username = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.chiscsi_conf = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.disk_geometry = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.driver_client_cert = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.driver_use_ssl = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.extra_capabilities = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.filter_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.goodness_function = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Running cmd (subprocess): mount.quobyte {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.iser_helper = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.iser_ip_address = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.iser_port = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.iser_target_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_host = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_login = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_mount_options = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_password = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_private_key = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_share_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_ssh_port = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.num_shell_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.nvmet_port_id = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.replication_device = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.report_discard_supported = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.reserved_percentage = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.scst_target_driver = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.storage_protocol = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.target_helper = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.target_ip_address = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.target_port = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.target_prefix = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.target_protocol = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.trace_flags = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.use_chap_auth = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_clear = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_clear_size = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] QuobyteHD.volumes_dir = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_notifications.driver = [] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] key_manager.fixed_key = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.barbican_api_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.barbican_endpoint = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.barbican_endpoint_type = public {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.barbican_region_name = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.number_of_retries = 60 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.retry_delay = 1 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.send_service_user_token = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.verify_ssl = True {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican.verify_ssl_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.auth_section = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.auth_type = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.cafile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.certfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.collect_timing = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.insecure = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.keyfile = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.split_loggers = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.timeout = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.tls_ciphers = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] barbican_service_user.tls_min_version = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.approle_role_id = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.approle_secret_id = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.auth_method = approle {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.auth_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.kv_mountpoint = secret {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.kv_path = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.kv_version = 2 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.namespace = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.root_token_id = **** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.ssl_ca_crt_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.timeout = 60.0 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.token_file = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.token_role = None {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.use_ssl = False {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 15:00:17 devstack cinder-volume[86791]: DEBUG oslo_service.backend._eventlet.service [None req-295add8b-a2c4-4cc9-b5d6-24b826573fb8 None None] ******************************************************************************** {{(pid=86791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 15:00:17 devstack quobyte-client[87128]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 15:00:17 devstack quobyte-client[87128]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:17 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:17 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:18 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:18 devstack cinder-volume[87126]: INFO cinder.volume.driver [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.volume.driver [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_db.sqlalchemy.engines [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writer thread running {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.db.api [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Building query based on filter {{(pid=87126) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87126) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:18 devstack cinder-volume[87126]: INFO cinder.keymgr.migration [None req-6dda9c3a-cb1d-4382-974d-b2e960663119 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 15:00:18 devstack sudo[87143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:18 devstack sudo[87143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:18 devstack sudo[87143]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:00:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Driver initialization completed successfully. Nov 05 15:00:18 devstack cinder-volume[87126]: INFO cinder.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Initiating service 3 cleanup Nov 05 15:00:18 devstack cinder-volume[87126]: INFO cinder.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Service 3 cleanup completed. Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.service [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Creating RPC server for service cinder-volume {{(pid=87126) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.service [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87126) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 15:00:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:00:18 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:00:18 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:00:18 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Nov 05 15:00:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:00:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36426b5c-6921-4451-a624-0c6b8b48db29 None None] Driver post RPC initialization completed successfully. Nov 05 15:00:27 devstack cinder-volume[86791]: DEBUG dbcounter [-] [86791] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:00:28 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:00:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:00:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:00:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 6 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:00:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Flow 'volume_create_manager' (ab54875d-e9ba-442d-981b-67879ac23ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0d17a1-6ad6-4455-8ec5-3737611574a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0d17a1-6ad6-4455-8ec5-3737611574a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-281538836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b57d7a-f85a-4f84-8e66-87feee523f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c91176104d469fba1aaf323337e407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:01:17Z,use_quota=True,user_id='97bc0057774245dea62ea810221d2cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4d9bc7-6262-4057-88a5-96da4426f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4d9bc7-6262-4057-88a5-96da4426f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6caf534a-b8d6-4328-920e-9139d4c1e906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6caf534a-b8d6-4328-920e-9139d4c1e906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b57d7a-f85a-4f84-8e66-87feee523f85', 'volume_name': 'volume-00b57d7a-f85a-4f84-8e66-87feee523f85', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64a58c8-d28a-4ee3-9851-ec21c2e7cbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64a58c8-d28a-4ee3-9851-ec21c2e7cbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86435d1-a957-4a0c-ad9e-ef31d84afa4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Volume 00b57d7a-f85a-4f84-8e66-87feee523f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b57d7a-f85a-4f84-8e66-87feee523f85', 'volume_size': 1} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-281538836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b57d7a-f85a-4f84-8e66-87feee523f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c91176104d469fba1aaf323337e407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:01:17Z,use_quota=True,user_id='97bc0057774245dea62ea810221d2cce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Creating volume 00b57d7a-f85a-4f84-8e66-87feee523f85 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:01:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:01:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:17 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 1073741824 Nov 05 15:01:17 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:18 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 1073741824" returned: 0 in 0.759s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:18 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 Nov 05 15:01:18 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:18 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86435d1-a957-4a0c-ad9e-ef31d84afa4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b57d7a-f85a-4f84-8e66-87feee523f85', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f4e4df-67a3-4846-874c-4205fceeed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Volume volume-00b57d7a-f85a-4f84-8e66-87feee523f85 (00b57d7a-f85a-4f84-8e66-87feee523f85): created successfully Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f4e4df-67a3-4846-874c-4205fceeed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Flow 'volume_create_manager' (ab54875d-e9ba-442d-981b-67879ac23ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:01:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bd24ed4f-fc27-4de5-89fa-da3e48b363ad tempest-TaggedAttachmentsTest-1290367786 None] Created volume successfully. Nov 05 15:01:28 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:01:28 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Flow 'volume_create_manager' (f63bdf84-0963-46ef-8ac6-1022cb12eca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ead3b88-c351-44bd-a13f-d949c08f8923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ead3b88-c351-44bd-a13f-d949c08f8923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-123462868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779a594d-63ef-4f70-94c3-6b74ec2ec8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835ac09f9c8d4643bd4be9c48ea7e13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:01:35Z,use_quota=True,user_id='c3558299bae640d9890bbbc8374b9719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc91059-b255-4bef-8fa3-a760f410c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc91059-b255-4bef-8fa3-a760f410c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a3a51b-e2fa-41db-8807-2f1f0d809cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45a3a51b-e2fa-41db-8807-2f1f0d809cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779a594d-63ef-4f70-94c3-6b74ec2ec8f5', 'volume_name': 'volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe715397-014c-4d20-becf-d716c9b947c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe715397-014c-4d20-becf-d716c9b947c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44022f44-d5ef-4781-922a-be9dfd06294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Volume 779a594d-63ef-4f70-94c3-6b74ec2ec8f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5', 'volume_size': 1} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-123462868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779a594d-63ef-4f70-94c3-6b74ec2ec8f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='835ac09f9c8d4643bd4be9c48ea7e13a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:01:35Z,use_quota=True,user_id='c3558299bae640d9890bbbc8374b9719',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Creating volume 779a594d-63ef-4f70-94c3-6b74ec2ec8f5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:01:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:01:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:35 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 1073741824 Nov 05 15:01:35 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:36 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 1073741824" returned: 0 in 0.753s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:36 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 Nov 05 15:01:36 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:36 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44022f44-d5ef-4781-922a-be9dfd06294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5e3461-b721-4309-a3a8-9ecf6689b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Volume volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 (779a594d-63ef-4f70-94c3-6b74ec2ec8f5): created successfully Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5e3461-b721-4309-a3a8-9ecf6689b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Flow 'volume_create_manager' (f63bdf84-0963-46ef-8ac6-1022cb12eca5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:01:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-01fcb1bc-ec6e-44ea-84c7-7bc293a0960f tempest-DeleteServersTestJSON-819464062 None] Created volume successfully. Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:39 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:01:39 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:39 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.581s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 6 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:01:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:01:43 devstack cinder-volume[87126]: WARNING py.warnings [req-cb299756-b3e5-46d5-9d4d-dc13bc1464c5 req-b335369d-97cc-45a4-bc31-235d3fac4bbb tempest-DeleteServersTestJSON-819464062 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 05 15:01:43 devstack cinder-volume[87126]: .first() Nov 05 15:01:43 devstack cinder-volume[87126]: Nov 05 15:01:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-cb299756-b3e5-46d5-9d4d-dc13bc1464c5 req-b335369d-97cc-45a4-bc31-235d3fac4bbb tempest-DeleteServersTestJSON-819464062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-cb299756-b3e5-46d5-9d4d-dc13bc1464c5 req-b335369d-97cc-45a4-bc31-235d3fac4bbb tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-cb299756-b3e5-46d5-9d4d-dc13bc1464c5 req-b335369d-97cc-45a4-bc31-235d3fac4bbb tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-cb299756-b3e5-46d5-9d4d-dc13bc1464c5 req-b335369d-97cc-45a4-bc31-235d3fac4bbb tempest-DeleteServersTestJSON-819464062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43f7e673-5882-4e72-b4c3-645501f41f27', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:01:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-cb299756-b3e5-46d5-9d4d-dc13bc1464c5 req-b335369d-97cc-45a4-bc31-235d3fac4bbb tempest-DeleteServersTestJSON-819464062 None] attachment_update completed successfully. Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Flow 'volume_create_manager' (5ee25774-73a9-4b6b-b603-4f0ab0766b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b8f5b3-e5d5-4d6a-9a0e-9e66c5e9c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b8f5b3-e5d5-4d6a-9a0e-9e66c5e9c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1921885436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfecd9b9-77f0-488c-a1b4-3c11425fd989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587f7270d904615911c1fbca06753b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:01:50Z,use_quota=True,user_id='c18d7d90e5454c5ca5d0e2ce31f90dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc93ac40-6bf6-4146-8462-7c5dcc7a0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc93ac40-6bf6-4146-8462-7c5dcc7a0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f30580-ae32-460b-9897-2fdf3e3d9837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f30580-ae32-460b-9897-2fdf3e3d9837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfecd9b9-77f0-488c-a1b4-3c11425fd989', 'volume_name': 'volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207b763f-8fcb-4a65-8ea2-ac7db6da5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207b763f-8fcb-4a65-8ea2-ac7db6da5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9870aa38-0dbf-4729-a90c-2e0c1967d090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Volume dfecd9b9-77f0-488c-a1b4-3c11425fd989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989', 'volume_size': 1} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1921885436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfecd9b9-77f0-488c-a1b4-3c11425fd989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587f7270d904615911c1fbca06753b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:01:50Z,use_quota=True,user_id='c18d7d90e5454c5ca5d0e2ce31f90dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Creating volume dfecd9b9-77f0-488c-a1b4-3c11425fd989 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:01:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:01:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:50 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 1073741824 Nov 05 15:01:50 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:51 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 1073741824" returned: 0 in 0.914s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:51 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 Nov 05 15:01:51 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:51 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9870aa38-0dbf-4729-a90c-2e0c1967d090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc762c1-ebd6-476c-88fc-2a3191b744ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:01:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Volume volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 (dfecd9b9-77f0-488c-a1b4-3c11425fd989): created successfully Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc762c1-ebd6-476c-88fc-2a3191b744ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:01:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Flow 'volume_create_manager' (5ee25774-73a9-4b6b-b603-4f0ab0766b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:01:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-68d78ad3-d969-4bea-97f7-36d871526382 tempest-VolumesAdminNegativeTest-53929272 None] Created volume successfully. Nov 05 15:01:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-782a1d6f-2043-4f79-9e75-2f30351e5931 req-6013dd28-afd4-46d1-9950-a1ab05f1c5d0 tempest-DeleteServersTestJSON-819464062 None] Terminate volume connection completed successfully. Nov 05 15:01:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-782a1d6f-2043-4f79-9e75-2f30351e5931 req-6013dd28-afd4-46d1-9950-a1ab05f1c5d0 tempest-DeleteServersTestJSON-819464062 None] Deleting attachment 43f7e673-5882-4e72-b4c3-645501f41f27. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:01:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Acquiring lock "cinder-dfecd9b9-77f0-488c-a1b4-3c11425fd989-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:01:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Lock "cinder-dfecd9b9-77f0-488c-a1b4-3c11425fd989-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:01:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Acquiring lock "cinder-quobyte-dfecd9b9-77f0-488c-a1b4-3c11425fd989" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:01:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Lock "cinder-quobyte-dfecd9b9-77f0-488c-a1b4-3c11425fd989" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:01:53 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplcg4c4o6/privsep.sock'] Nov 05 15:01:53 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplcg4c4o6/privsep.sock Nov 05 15:01:53 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Acquiring lock "cinder-779a594d-63ef-4f70-94c3-6b74ec2ec8f5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 15:01:55 devstack cinder-volume[87126]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 15:01:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Lock "cinder-779a594d-63ef-4f70-94c3-6b74ec2ec8f5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:01:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Acquiring lock "cinder-quobyte-779a594d-63ef-4f70-94c3-6b74ec2ec8f5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:01:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Lock "cinder-quobyte-779a594d-63ef-4f70-94c3-6b74ec2ec8f5" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:01:56 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:56 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Spawned new privsep daemon via rootwrap Nov 05 15:01:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Accepted privsep connection to /tmp/tmplcg4c4o6/privsep.sock {{(pid=87126) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 15:01:56 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 15:01:56 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 15:01:56 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 15:01:56 devstack cinder-volume[87126]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88823 Nov 05 15:01:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd037d-7c05-4e82-b1a8-d68fd53f8943]: (2,) {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:01:56 devstack cinder-volume[87126]: WARNING oslo_privsep.priv_context [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] privsep daemon already running Nov 05 15:01:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b037fc10-4845-4ebf-9888-02b9de906a35]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:01:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[af43c759-8b8e-4655-8dc4-057945025aef]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:01:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:56 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 Nov 05 15:01:56 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:56 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 Nov 05 15:01:56 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:57 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5" returned: 0 in 0.719s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:57 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5 Nov 05 15:01:57 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:57 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989" returned: 0 in 0.841s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:57 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989 Nov 05 15:01:57 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:57 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-779a594d-63ef-4f70-94c3-6b74ec2ec8f5" returned: 0 in 0.493s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Lock "cinder-quobyte-779a594d-63ef-4f70-94c3-6b74ec2ec8f5" released by "delete_volume" :: held 1.673s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:01:57 devstack cinder-volume[87126]: WARNING cinder.quota [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:01:57 devstack cinder-volume[87126]: WARNING cinder.quota [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:01:57 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfecd9b9-77f0-488c-a1b4-3c11425fd989" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Lock "cinder-quobyte-dfecd9b9-77f0-488c-a1b4-3c11425fd989" released by "delete_volume" :: held 4.170s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:01:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Created reservations ['2786d9d7-2dfb-4aa4-93e5-e7b8a71ed621', 'cd15a255-2b38-4965-983b-0fbfacd61f3e', '12512831-758e-400b-bba5-3abb5ef6da82', 'ffcce711-a6d9-47d7-8950-336fcf6273db'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:58 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:01:58 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Created reservations ['fad5017c-29d4-4575-a86b-3781739ce88c', 'd6d6e2c9-7bfd-4c35-9ae2-d3ce136a88a6', 'c4b25920-4a0c-4abd-b330-b7a1e0a0aaac', 'daca145a-741c-49be-9061-8d8f812a6743'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:01:58 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:01:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Deleted volume successfully. Nov 05 15:01:58 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:01:58 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:01:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c539a9af-add2-4567-8e64-653efc79058c tempest-DeleteServersTestJSON-819464062 None] Lock "cinder-779a594d-63ef-4f70-94c3-6b74ec2ec8f5-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:01:59 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Nov 05 15:01:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.530s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:01:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:01:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Deleted volume successfully. Nov 05 15:01:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f458e78f-180b-4814-b6e3-41c5ee231ae0 tempest-VolumesAdminNegativeTest-53929272 None] Lock "cinder-dfecd9b9-77f0-488c-a1b4-3c11425fd989-delete_volume" released by "delete_volume" :: held 5.736s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:08 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:02:09 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=19,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Flow 'volume_create_manager' (80bf1488-ad65-45d5-8a34-085bd878d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbf6a3-f657-448a-af9d-71266f84c04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbf6a3-f657-448a-af9d-71266f84c04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1504497988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff8961a-2870-46ac-afc8-7ec612cafc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf5b45ac0054383b7298b3d0e376c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:02:13Z,use_quota=True,user_id='c80aae7fae504e94827b0f74ec09b6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666cec25-5d17-4852-92e0-a8dd8ac30328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (666cec25-5d17-4852-92e0-a8dd8ac30328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eac84aa-9c14-4c3d-a76e-3bd21eeadd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eac84aa-9c14-4c3d-a76e-3bd21eeadd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff8961a-2870-46ac-afc8-7ec612cafc23', 'volume_name': 'volume-cff8961a-2870-46ac-afc8-7ec612cafc23', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cc09e1-b5dc-42ca-afc5-da568ad78389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cc09e1-b5dc-42ca-afc5-da568ad78389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eea9e5-fdaf-4227-9cd5-d0722a4abb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Volume cff8961a-2870-46ac-afc8-7ec612cafc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff8961a-2870-46ac-afc8-7ec612cafc23', 'volume_size': 1} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1504497988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff8961a-2870-46ac-afc8-7ec612cafc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bf5b45ac0054383b7298b3d0e376c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:02:13Z,use_quota=True,user_id='c80aae7fae504e94827b0f74ec09b6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Creating volume cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:02:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:13 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 1073741824 Nov 05 15:02:13 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:13 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 1073741824" returned: 0 in 0.595s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:13 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 Nov 05 15:02:13 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:14 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eea9e5-fdaf-4227-9cd5-d0722a4abb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff8961a-2870-46ac-afc8-7ec612cafc23', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d435c5-6373-46b9-bde4-d4991b803f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Volume volume-cff8961a-2870-46ac-afc8-7ec612cafc23 (cff8961a-2870-46ac-afc8-7ec612cafc23): created successfully Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d435c5-6373-46b9-bde4-d4991b803f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Flow 'volume_create_manager' (80bf1488-ad65-45d5-8a34-085bd878d006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:02:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-19a45da3-9750-41e2-baf4-382041b781be req-a5576e0f-3b55-487f-a764-e2a8d585631d tempest-VolumesSnapshotsTestJSON-842258294 None] Created volume successfully. Nov 05 15:02:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Creating offline snapshot 9aa97bbf-d944-4385-bac6-6989c8d2e0fb of volume cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:02:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae87b9-0cff-40dd-bb0b-e63f00b7c08b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:15 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 Nov 05 15:02:15 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:16 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:16 devstack sudo[88961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb 1G Nov 05 15:02:16 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:16 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb 1G" returned: 0 in 0.718s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff8961a-2870-46ac-afc8-7ec612cafc23 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:16 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff8961a-2870-46ac-afc8-7ec612cafc23 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb Nov 05 15:02:16 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:17 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff8961a-2870-46ac-afc8-7ec612cafc23 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb is being set with open permissions: ugo+rw Nov 05 15:02:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:17 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb Nov 05 15:02:17 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:17 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:17 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info Nov 05 15:02:17 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:18 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info is being set with open permissions: ugo+rw Nov 05 15:02:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:18 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info Nov 05 15:02:18 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:18 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.info" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.878s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-6f95c4d9-129a-4bf2-b9a1-8083ecd1a23d req-8bcab39c-cd47-419a-bc79-6dcd7df2bd5b tempest-VolumesSnapshotsTestJSON-842258294 None] Create snapshot completed successfully Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "cinder-9aa97bbf-d944-4385-bac6-6989c8d2e0fb-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-9aa97bbf-d944-4385-bac6-6989c8d2e0fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "cinder-quobyte-cff8961a-2870-46ac-afc8-7ec612cafc23" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-quobyte-cff8961a-2870-46ac-afc8-7ec612cafc23" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "cinder-quobyte-9aa97bbf-d944-4385-bac6-6989c8d2e0fb" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-quobyte-9aa97bbf-d944-4385-bac6-6989c8d2e0fb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Deleting offline snapshot 9aa97bbf-d944-4385-bac6-6989c8d2e0fb of volume cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] snapshot_file for this snap is: volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e869b31-3eaa-4cea-9d0d-753f94dcb492]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:19 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb Nov 05 15:02:19 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:20 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff8961a-2870-46ac-afc8-7ec612cafc23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[680528c1-3668-4503-ab16-c5f53a860806]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:20 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 Nov 05 15:02:20 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:20 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23" returned: 0 in 0.446s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:20 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb Nov 05 15:02:20 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:21 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:21 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb Nov 05 15:02:21 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:21 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23.9aa97bbf-d944-4385-bac6-6989c8d2e0fb" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-quobyte-9aa97bbf-d944-4385-bac6-6989c8d2e0fb" released by "_delete_snapshot" :: held 1.612s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-quobyte-cff8961a-2870-46ac-afc8-7ec612cafc23" released by "delete_snapshot" :: held 1.636s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:21 devstack cinder-volume[87126]: WARNING cinder.quota [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG cinder.quota [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Created reservations ['2ce1d0f9-52bc-4926-b0a7-b4e590b385bd', 'dda120e2-3c5c-495e-b04c-f8744ce1eebb', '3400e7fe-b6e0-4d05-ad82-f7015a178376', 'efabfaeb-7031-490a-b736-443a214d1c83'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Delete snapshot completed successfully. Nov 05 15:02:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-11bf9a70-a63e-41b5-a037-441f0d4512a5 req-acc52e59-abd8-4842-b542-512bc8afa711 tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-9aa97bbf-d944-4385-bac6-6989c8d2e0fb-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "cinder-cff8961a-2870-46ac-afc8-7ec612cafc23-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-cff8961a-2870-46ac-afc8-7ec612cafc23-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "cinder-quobyte-cff8961a-2870-46ac-afc8-7ec612cafc23" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-quobyte-cff8961a-2870-46ac-afc8-7ec612cafc23" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8e64b7-29a8-4a0a-ac50-2db9ccfc4671]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:23 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 Nov 05 15:02:23 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:23 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23" returned: 0 in 0.719s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:23 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23 Nov 05 15:02:23 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:24 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-cff8961a-2870-46ac-afc8-7ec612cafc23" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-quobyte-cff8961a-2870-46ac-afc8-7ec612cafc23" released by "delete_volume" :: held 1.272s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG cinder.quota [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Created reservations ['2ad54bbf-3b60-43ce-a487-3f78afc9fe94', '5f4e97a8-2372-4d7a-823f-f7b0d99b8a46', 'fc67765b-799b-4008-9e72-fc7a1101a4de', 'cfb159f9-c534-4ea4-b026-67cca8f590ad'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:24 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:02:24 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:25 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.874s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:25 devstack cinder-volume[87126]: DEBUG cinder.manager [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:02:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Deleted volume successfully. Nov 05 15:02:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-6b77c5ec-e61e-433a-87f7-c6ec26d48237 req-d9c63699-04a8-454f-8471-485cb8798d8d tempest-VolumesSnapshotsTestJSON-842258294 None] Lock "cinder-cff8961a-2870-46ac-afc8-7ec612cafc23-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-2f84f996-2522-487f-b040-6ec15a1a330b req-c1e344db-8820-448c-8ddb-662d94b1140e tempest-TaggedAttachmentsTest-1290367786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-2f84f996-2522-487f-b040-6ec15a1a330b req-c1e344db-8820-448c-8ddb-662d94b1140e tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-2f84f996-2522-487f-b040-6ec15a1a330b req-c1e344db-8820-448c-8ddb-662d94b1140e tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-2f84f996-2522-487f-b040-6ec15a1a330b req-c1e344db-8820-448c-8ddb-662d94b1140e tempest-TaggedAttachmentsTest-1290367786 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-00b57d7a-f85a-4f84-8e66-87feee523f85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40d4692e-35e5-4439-8d65-00b216543d30', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:02:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-2f84f996-2522-487f-b040-6ec15a1a330b req-c1e344db-8820-448c-8ddb-662d94b1140e tempest-TaggedAttachmentsTest-1290367786 None] attachment_update completed successfully. Nov 05 15:02:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-656d2386-9139-4c76-b2f5-3b51a98f892a req-f3d43a24-0f6c-4cda-bced-083ecbc8ccb8 tempest-TaggedAttachmentsTest-1290367786 None] Terminate volume connection completed successfully. Nov 05 15:02:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-656d2386-9139-4c76-b2f5-3b51a98f892a req-f3d43a24-0f6c-4cda-bced-083ecbc8ccb8 tempest-TaggedAttachmentsTest-1290367786 None] Deleting attachment 40d4692e-35e5-4439-8d65-00b216543d30. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Flow 'volume_create_manager' (7492ef4a-c63a-45ea-bac7-9c9ca45c32e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a596cd-7e63-47b0-a92e-95830dac3c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a596cd-7e63-47b0-a92e-95830dac3c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-805204064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7454c-94ae-4b8f-88dd-72b0cd71a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffccda27bf8c48afa10dee97c73e9371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:02:36Z,use_quota=True,user_id='7882f3983c9140dcbf3be4b5e985c2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee685ac5-45ff-4897-97db-d0a0bb510406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee685ac5-45ff-4897-97db-d0a0bb510406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2208c3e1-1ab9-41ae-8082-c95ffcfe447d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2208c3e1-1ab9-41ae-8082-c95ffcfe447d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba7454c-94ae-4b8f-88dd-72b0cd71a859', 'volume_name': 'volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980e21ff-bf0e-4880-a1e3-b753655eb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980e21ff-bf0e-4880-a1e3-b753655eb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b19518-e4a0-421a-857a-de5335406866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859', 'volume_size': 1} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-805204064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7454c-94ae-4b8f-88dd-72b0cd71a859,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffccda27bf8c48afa10dee97c73e9371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:02:36Z,use_quota=True,user_id='7882f3983c9140dcbf3be4b5e985c2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Creating volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:02:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:02:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:35 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 1073741824 Nov 05 15:02:35 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:36 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 1073741824" returned: 0 in 0.599s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:36 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 Nov 05 15:02:36 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:36 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:02:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b19518-e4a0-421a-857a-de5335406866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b8c4d1-3adf-4752-b7c8-a821c886f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Volume volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 (4ba7454c-94ae-4b8f-88dd-72b0cd71a859): created successfully Nov 05 15:02:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b8c4d1-3adf-4752-b7c8-a821c886f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Flow 'volume_create_manager' (7492ef4a-c63a-45ea-bac7-9c9ca45c32e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:02:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8de6cb8b-fdb8-465f-aa68-f4bbec6e6265 tempest-SnapshotsActionsTest-1570926665 None] Created volume successfully. Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Creating offline snapshot d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1790ff7-d422-408a-b3b7-a6797be30952]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:38 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 Nov 05 15:02:38 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:38 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:38 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 1G Nov 05 15:02:38 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:39 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:02:39 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 1G" returned: 0 in 0.605s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:39 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:39 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:39 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:39 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 8 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:02:39 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:39 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 is being set with open permissions: ugo+rw Nov 05 15:02:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:39 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:39 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:40 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:40 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info Nov 05 15:02:40 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:40 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:40 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info is being set with open permissions: ugo+rw Nov 05 15:02:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:40 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info Nov 05 15:02:40 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:40 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.info" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-35d6a768-32f5-434f-8c2f-a697ace0464b tempest-SnapshotsActionsTest-1570926665 None] Create snapshot completed successfully Nov 05 15:02:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Creating offline snapshot bf0ecf85-e716-424d-bbeb-b0f197beb4d4 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d18a4-e95e-41eb-a721-4f55e5e2fae5]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:42 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:42 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:42 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-54fa36b6-710c-42ef-bc9c-d8c649b4c186 tempest-GroupsV320Test-1043068854 None] Group tempest-GroupsV320Test-Group-1170533220: creating Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:42 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 1G Nov 05 15:02:42 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-54fa36b6-710c-42ef-bc9c-d8c649b4c186 tempest-GroupsV320Test-1043068854 None] Group tempest-GroupsV320Test-Group-1170533220: created successfully Nov 05 15:02:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-54fa36b6-710c-42ef-bc9c-d8c649b4c186 tempest-GroupsV320Test-1043068854 None] Create group completed successfully. Nov 05 15:02:42 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 1G" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:43 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 Nov 05 15:02:43 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:43 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:43 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 is being set with open permissions: ugo+rw Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:43 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 Nov 05 15:02:43 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:43 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.710s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3ac9f589-88cf-4ff5-b11b-a89848c2e6a7 tempest-SnapshotsActionsTest-1570926665 None] Create snapshot completed successfully Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Acquiring lock "cinder-00b57d7a-f85a-4f84-8e66-87feee523f85-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Lock "cinder-00b57d7a-f85a-4f84-8e66-87feee523f85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Acquiring lock "cinder-quobyte-00b57d7a-f85a-4f84-8e66-87feee523f85" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Lock "cinder-quobyte-00b57d7a-f85a-4f84-8e66-87feee523f85" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c28a4db-6314-4b00-bf19-ec2864cf6c29]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:44 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 Nov 05 15:02:44 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-bf0ecf85-e716-424d-bbeb-b0f197beb4d4-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:44 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-bf0ecf85-e716-424d-bbeb-b0f197beb4d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-bf0ecf85-e716-424d-bbeb-b0f197beb4d4" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:44 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85 Nov 05 15:02:44 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Created reservations ['a4d47fde-d995-450f-80b5-13250cba919c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-bf0ecf85-e716-424d-bbeb-b0f197beb4d4" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Deleting offline snapshot bf0ecf85-e716-424d-bbeb-b0f197beb4d4 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] snapshot_file for this snap is: volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c105a42e-b625-47bc-af2b-a575156b31dc]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:44 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:02:44 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:44 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 Nov 05 15:02:44 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:44 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-00b57d7a-f85a-4f84-8e66-87feee523f85" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Lock "cinder-quobyte-00b57d7a-f85a-4f84-8e66-87feee523f85" released by "delete_volume" :: held 0.842s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Created reservations ['44ad72f8-631e-4bcb-b322-fa196f2ae91d', '71c85598-c4b2-4b08-814c-7dd404307d54', '723515a9-aa75-4d2b-b234-84cc21fc78db', '7c395b46-47bb-4190-9f82-039f6a7bb9fc'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:44 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:02:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e7993ca0-e6b4-44cd-a558-2cc64bcdd6e8 tempest-GroupsV320Test-1043068854 None] Delete group completed successfully. Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:44 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4" returned: 0 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:44 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:02:44 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa04634-00c7-40e2-a9a3-c95ac51ea96e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:45 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:45 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:45 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:02:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Deleted volume successfully. Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c05a669d-15be-48ae-9724-5666feaddb07 tempest-TaggedAttachmentsTest-1290367786 None] Lock "cinder-00b57d7a-f85a-4f84-8e66-87feee523f85-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:45 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.381s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:45 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 Nov 05 15:02:45 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:45 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4" returned: 0 in 0.452s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:45 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4 Nov 05 15:02:45 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:46 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.bf0ecf85-e716-424d-bbeb-b0f197beb4d4" returned: 0 in 0.343s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-bf0ecf85-e716-424d-bbeb-b0f197beb4d4" released by "_delete_snapshot" :: held 1.720s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" released by "delete_snapshot" :: held 1.760s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Created reservations ['0f067430-963a-4141-bc25-a9a6a12114ac', '2c350b4a-5100-4af1-b930-dfb7cad76631', '1a60cce9-a3e9-48ff-a5c6-d788e9c13d44', '52ad634a-4f5b-48e2-9914-a60548b53c21'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Delete snapshot completed successfully. Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-18c0a673-0d83-4f6e-a4ec-ed837942e851 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-bf0ecf85-e716-424d-bbeb-b0f197beb4d4-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Creating offline snapshot cc096a76-dc7d-40f5-9e0a-9cbb29d39891 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[795890f6-e5f7-46e1-9180-f2444e41f494]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:47 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:47 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:47 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.387s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:47 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 1G Nov 05 15:02:47 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:47 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 1G" returned: 0 in 0.539s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:47 devstack sudo[89845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 Nov 05 15:02:47 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:48 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 is being set with open permissions: ugo+rw Nov 05 15:02:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:48 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 Nov 05 15:02:48 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:48 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.608s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-894cb5e2-0296-4945-a6a7-42f68c1c58fa tempest-SnapshotsActionsTest-1570926665 None] Create snapshot completed successfully Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-cc096a76-dc7d-40f5-9e0a-9cbb29d39891-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-cc096a76-dc7d-40f5-9e0a-9cbb29d39891-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-cc096a76-dc7d-40f5-9e0a-9cbb29d39891" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-cc096a76-dc7d-40f5-9e0a-9cbb29d39891" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Deleting offline snapshot cc096a76-dc7d-40f5-9e0a-9cbb29d39891 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] snapshot_file for this snap is: volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ace383-8530-4dcf-90f3-61cd5ce7a0bf]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:49 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 Nov 05 15:02:49 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:49 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891" returned: 0 in 0.472s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a6415-6b4b-4b67-8cc5-c9dffc8702ec]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:49 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:49 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:50 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:50 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 Nov 05 15:02:50 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:50 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:50 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891 Nov 05 15:02:50 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:50 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.cc096a76-dc7d-40f5-9e0a-9cbb29d39891" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-cc096a76-dc7d-40f5-9e0a-9cbb29d39891" released by "_delete_snapshot" :: held 1.707s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" released by "delete_snapshot" :: held 1.738s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Created reservations ['9ff2c592-d48a-47b9-94e4-101510924b9e', '9f4e14e8-1a1b-46d1-b673-724b319c83e1', 'f2173e37-829e-49fb-a173-51f24fa0ea3f', '85cb104a-110f-4736-b648-6676a1e7140f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Delete snapshot completed successfully. Nov 05 15:02:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f96af27e-8e57-44b4-87bd-3f4b868ebad5 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-cc096a76-dc7d-40f5-9e0a-9cbb29d39891-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:02:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Flow 'volume_create_manager' (151fb200-b044-47af-9b31-28b3fc59a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:02:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec7161d-b924-4fbe-a91f-6f965cc5dde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec7161d-b924-4fbe-a91f-6f965cc5dde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1298205941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04664867-debd-4d3c-9c79-607ab079d4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c048d1d8fcd45539540d0b0b8160988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:02:52Z,use_quota=True,user_id='036f4d818c8a40638dc763e32a19310e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731afe03-fbc9-400e-a92d-4e86316d822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731afe03-fbc9-400e-a92d-4e86316d822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fb6245-a2e1-4f3b-ab56-9ab399057f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fb6245-a2e1-4f3b-ab56-9ab399057f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04664867-debd-4d3c-9c79-607ab079d4ea', 'volume_name': 'volume-04664867-debd-4d3c-9c79-607ab079d4ea', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26807f8f-f76b-4956-ac0f-e2fd271ba24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26807f8f-f76b-4956-ac0f-e2fd271ba24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f893ce50-7960-47b2-a2c8-0af9fd36cda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Volume 04664867-debd-4d3c-9c79-607ab079d4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04664867-debd-4d3c-9c79-607ab079d4ea', 'volume_size': 1} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1298205941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04664867-debd-4d3c-9c79-607ab079d4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c048d1d8fcd45539540d0b0b8160988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:02:52Z,use_quota=True,user_id='036f4d818c8a40638dc763e32a19310e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Creating volume 04664867-debd-4d3c-9c79-607ab079d4ea {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:02:52 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:52 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea 1073741824 Nov 05 15:02:52 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:52 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea 1073741824" returned: 0 in 0.709s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:52 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea Nov 05 15:02:52 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:53 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.996s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Creating offline snapshot 566ac7b7-c835-43c6-baab-41c724f40395 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f893ce50-7960-47b2-a2c8-0af9fd36cda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04664867-debd-4d3c-9c79-607ab079d4ea', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27acfe42-9495-44bd-a059-366377e3f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cce1f7-e1e2-424c-94ac-304ee7859259]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Volume volume-04664867-debd-4d3c-9c79-607ab079d4ea (04664867-debd-4d3c-9c79-607ab079d4ea): created successfully Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27acfe42-9495-44bd-a059-366377e3f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Flow 'volume_create_manager' (151fb200-b044-47af-9b31-28b3fc59a323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:02:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-59654ead-2ba0-4f5e-93a9-3a910a414ff4 tempest-ServerActionsTestOtherA-98116980 None] Created volume successfully. Nov 05 15:02:53 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:53 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:53 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.508s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:53 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 1G Nov 05 15:02:53 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:54 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 1G" returned: 0 in 0.563s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:54 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 Nov 05 15:02:54 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:54 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:54 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 is being set with open permissions: ugo+rw Nov 05 15:02:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:54 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 Nov 05 15:02:54 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:55 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:02:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ff940e1e-aa7f-406e-a47f-c21dccb8508a tempest-SnapshotsActionsTest-1570926665 None] Create snapshot completed successfully Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-566ac7b7-c835-43c6-baab-41c724f40395-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-566ac7b7-c835-43c6-baab-41c724f40395-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-566ac7b7-c835-43c6-baab-41c724f40395" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-566ac7b7-c835-43c6-baab-41c724f40395" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Deleting offline snapshot 566ac7b7-c835-43c6-baab-41c724f40395 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] snapshot_file for this snap is: volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e50981-56ad-479b-b362-db9439ac674b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:55 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 Nov 05 15:02:55 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:55 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395" returned: 0 in 0.432s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bea507-ad30-4275-bd02-0744e963152a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:56 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:56 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:56 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:56 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 Nov 05 15:02:56 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:57 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395" returned: 0 in 0.636s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:57 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395 Nov 05 15:02:57 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:57 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.566ac7b7-c835-43c6-baab-41c724f40395" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-566ac7b7-c835-43c6-baab-41c724f40395" released by "_delete_snapshot" :: held 2.141s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" released by "delete_snapshot" :: held 2.187s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Created reservations ['119b5f67-9565-4a6f-b08e-785c55e64427', '21b09a36-6499-40ca-994f-42b0f130d25e', 'd99443dd-9d64-43cd-be52-6b7f63fb4597', 'c10e2655-f832-4176-ac9c-498c13e1c2cd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:02:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Delete snapshot completed successfully. Nov 05 15:02:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7d941ed5-3eb8-4c6d-92a1-be79540551e4 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-566ac7b7-c835-43c6-baab-41c724f40395-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Creating offline snapshot 06bfd4ec-642d-471d-b8d0-add8174ad0fe of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22033a6-ce64-4a66-b317-bd8a6857db14]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:59 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:02:59 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:02:59 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.449s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:02:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:02:59 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe 1G Nov 05 15:02:59 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:00 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe 1G" returned: 0 in 0.593s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:00 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe Nov 05 15:03:00 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:00 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:00 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe is being set with open permissions: ugo+rw Nov 05 15:03:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:00 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe Nov 05 15:03:00 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:01 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-17c9cb7d-d867-46b2-801d-f016716edff4 tempest-SnapshotsActionsTest-1570926665 None] Create snapshot completed successfully Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-06bfd4ec-642d-471d-b8d0-add8174ad0fe-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-06bfd4ec-642d-471d-b8d0-add8174ad0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Acquiring lock "cinder-quobyte-06bfd4ec-642d-471d-b8d0-add8174ad0fe" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-06bfd4ec-642d-471d-b8d0-add8174ad0fe" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Deleting offline snapshot 06bfd4ec-642d-471d-b8d0-add8174ad0fe of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] snapshot_file for this snap is: volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfc8fdb-5eb0-4a7b-8fbd-663ae5ad6787]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:01 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe Nov 05 15:03:01 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:02 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe" returned: 0 in 0.717s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:03:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb66d2e-fce9-47a4-84e1-45f8d8692235]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:02 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:03:02 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:03 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.678s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:03:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:03 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe Nov 05 15:03:03 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:03 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe" returned: 0 in 0.584s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:03 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe Nov 05 15:03:03 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:04 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.06bfd4ec-642d-471d-b8d0-add8174ad0fe" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-06bfd4ec-642d-471d-b8d0-add8174ad0fe" released by "_delete_snapshot" :: held 2.562s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" released by "delete_snapshot" :: held 2.637s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Created reservations ['fc01474c-5997-4019-939d-ac01942cda7c', '67c85953-4e79-4571-96ec-19bb863ebac0', '985eddda-b6c5-4993-9104-dfcf1988a907', '12f753d1-3f29-4ccc-9c7e-53d54ad39bd8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Delete snapshot completed successfully. Nov 05 15:03:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19ea8be9-92ac-4422-bdb7-1ef6ee2b23a1 tempest-SnapshotsActionsTest-118752982 None] Lock "cinder-06bfd4ec-642d-471d-b8d0-add8174ad0fe-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "cinder-d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "cinder-quobyte-d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-quobyte-d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Deleting offline snapshot d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 of volume 4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:03:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] snapshot_file for this snap is: volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:03:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c958da31-4d05-4626-8b37-5490bbbf4547]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:06 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:03:06 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:06 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:03:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7406b61f-4e55-4447-9f72-e9388b41ab91]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:06 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 Nov 05 15:03:06 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:07 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" returned: 0 in 0.460s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:07 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:03:07 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:07 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.435s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:07 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5 Nov 05 15:03:07 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:07 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859.d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-quobyte-d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5" released by "_delete_snapshot" :: held 2.017s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" released by "delete_snapshot" :: held 2.071s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Created reservations ['7b0dbec5-11e8-4cf9-b938-d16077d46646', '8be30e30-4484-43bf-9344-0857934c02ce', 'd0883520-7c44-49de-baba-106cae1b4ef9', '9e884f8d-9814-4378-856c-c809ae2cab47'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Delete snapshot completed successfully. Nov 05 15:03:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-77c84ab6-58c7-47cc-ab75-75fb7a339071 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-d020f8c6-d6dc-43e3-bb6a-ec8ae61be0b5-delete_snapshot" released by "delete_snapshot" :: held 2.483s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "cinder-4ba7454c-94ae-4b8f-88dd-72b0cd71a859-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-4ba7454c-94ae-4b8f-88dd-72b0cd71a859-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=74,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=80,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=23 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c73bc-6f7e-4c9d-bed3-e4eaceb05880]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:09 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 Nov 05 15:03:09 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:10 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" returned: 0 in 0.549s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:10 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859 Nov 05 15:03:10 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:10 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" returned: 0 in 0.507s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-quobyte-4ba7454c-94ae-4b8f-88dd-72b0cd71a859" released by "delete_volume" :: held 1.147s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Created reservations ['aa8cb471-42f9-4983-8a3e-b623459988da', 'b55ab0a3-0149-4a81-8a63-f9417671ad36', 'bdf2507c-0a16-4c32-a729-5497aaa814a7', 'dc89e2c0-2841-41b0-8062-67fb476fa405'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:10 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:03:10 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:11 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:03:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Deleted volume successfully. Nov 05 15:03:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ac942f11-7f41-49bf-b691-8b5a45658f17 tempest-SnapshotsActionsTest-1570926665 None] Lock "cinder-4ba7454c-94ae-4b8f-88dd-72b0cd71a859-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Flow 'volume_create_manager' (85a0dfdb-39c7-4603-9071-4b47617a5f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdebd49c-f377-437e-8e78-946acec5e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdebd49c-f377-437e-8e78-946acec5e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-481063768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efe83a8-27e3-448e-9b37-63dd93ffebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f48c562f1e4bc48438b3418da24de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:13Z,use_quota=True,user_id='0b080be7c2dd4b0aa0acb7228240d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0f4b15-082b-453f-8b5e-f177a5ca6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0f4b15-082b-453f-8b5e-f177a5ca6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018601f7-a124-44dc-a783-57b2f79c635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018601f7-a124-44dc-a783-57b2f79c635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4efe83a8-27e3-448e-9b37-63dd93ffebb5', 'volume_name': 'volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbad2e0-023a-4e85-9d27-1b9beb09f2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbad2e0-023a-4e85-9d27-1b9beb09f2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f8e74-0730-487f-8b16-324bf82b0274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Volume 4efe83a8-27e3-448e-9b37-63dd93ffebb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5', 'volume_size': 1} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-481063768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4efe83a8-27e3-448e-9b37-63dd93ffebb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f48c562f1e4bc48438b3418da24de6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:13Z,use_quota=True,user_id='0b080be7c2dd4b0aa0acb7228240d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Creating volume 4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:03:12 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:03:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:12 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 1073741824 Nov 05 15:03:12 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:13 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 1073741824" returned: 0 in 0.624s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:13 devstack sudo[90081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 Nov 05 15:03:13 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:13 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92f8e74-0730-487f-8b16-324bf82b0274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e82a0-a9ed-48a6-8bbf-fe540a4ed70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Volume volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 (4efe83a8-27e3-448e-9b37-63dd93ffebb5): created successfully Nov 05 15:03:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d11e82a0-a9ed-48a6-8bbf-fe540a4ed70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Flow 'volume_create_manager' (85a0dfdb-39c7-4603-9071-4b47617a5f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5350d8d3-4597-42a7-bba4-319a732496e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Created volume successfully. Nov 05 15:03:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Creating offline snapshot 513f876b-2de6-430f-9f20-daa703e1f084 of volume 4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:03:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab5a6f3-d605-4007-9b5b-ad29b9755d4a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:15 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 Nov 05 15:03:15 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:16 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5" returned: 0 in 0.833s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:16 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 1G Nov 05 15:03:16 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:16 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 1G" returned: 0 in 0.520s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:16 devstack sudo[90135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 Nov 05 15:03:16 devstack sudo[90135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:17 devstack sudo[90135]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 is being set with open permissions: ugo+rw Nov 05 15:03:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:17 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 Nov 05 15:03:17 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:17 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:17 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info Nov 05 15:03:17 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:17 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:17 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info is being set with open permissions: ugo+rw Nov 05 15:03:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:17 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info Nov 05 15:03:17 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:18 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.info" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.715s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-27d54fc3-f0d0-4e6f-abba-c2b795348bd3 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Create snapshot completed successfully Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "cinder-513f876b-2de6-430f-9f20-daa703e1f084-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-513f876b-2de6-430f-9f20-daa703e1f084-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "cinder-quobyte-4efe83a8-27e3-448e-9b37-63dd93ffebb5" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-quobyte-4efe83a8-27e3-448e-9b37-63dd93ffebb5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "cinder-quobyte-513f876b-2de6-430f-9f20-daa703e1f084" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-quobyte-513f876b-2de6-430f-9f20-daa703e1f084" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Deleting offline snapshot 513f876b-2de6-430f-9f20-daa703e1f084 of volume 4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] snapshot_file for this snap is: volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843bfef-2cd8-4045-988e-c01561a5edac]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:19 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 Nov 05 15:03:19 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:19 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd72d984-61f5-49d8-a440-9b8799ab9f80]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:19 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 Nov 05 15:03:19 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:20 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:20 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 Nov 05 15:03:20 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:20 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:20 devstack sudo[90204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084 Nov 05 15:03:20 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:20 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5.513f876b-2de6-430f-9f20-daa703e1f084" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-quobyte-513f876b-2de6-430f-9f20-daa703e1f084" released by "_delete_snapshot" :: held 1.617s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-quobyte-4efe83a8-27e3-448e-9b37-63dd93ffebb5" released by "delete_snapshot" :: held 1.653s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Created reservations ['e44f0bf9-cd2b-47dd-bcc2-7a3007e2f600', '2d048ab3-964a-4737-8d58-a1e5e8b7b82c', 'f1cf6157-918b-4c55-bc0c-0af2e10a03f4', 'a4c8dd36-d72e-401a-882c-b87f1fce8e02'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Delete snapshot completed successfully. Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-15482b87-6e88-4c42-bf16-efb3656e0e56 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-513f876b-2de6-430f-9f20-daa703e1f084-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "cinder-4efe83a8-27e3-448e-9b37-63dd93ffebb5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-4efe83a8-27e3-448e-9b37-63dd93ffebb5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "cinder-quobyte-4efe83a8-27e3-448e-9b37-63dd93ffebb5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-quobyte-4efe83a8-27e3-448e-9b37-63dd93ffebb5" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0406e05f-c60a-4d39-a7ff-df76054334a9]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:21 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 Nov 05 15:03:21 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:22 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5" returned: 0 in 0.530s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:22 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5 Nov 05 15:03:22 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:22 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4efe83a8-27e3-448e-9b37-63dd93ffebb5" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-quobyte-4efe83a8-27e3-448e-9b37-63dd93ffebb5" released by "delete_volume" :: held 0.946s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Created reservations ['c7d243a8-1554-409b-98d2-edd702f04034', '2f072ec8-2889-4ace-a9b2-19797923433f', '6c86b79c-fac2-4da7-9e89-32cd7030dfcf', '18c9ebf0-6dab-476c-9249-c9e4bb5deb64'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:22 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:03:22 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:22 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:03:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Deleted volume successfully. Nov 05 15:03:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87c13ed5-9b8d-425a-be7c-6bd3cf9207b5 tempest-VolumeSnapshotQuotasNegativeTestJSON-793532622 None] Lock "cinder-4efe83a8-27e3-448e-9b37-63dd93ffebb5-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b7359e19-022e-4105-a712-82a7ccf5f460 req-022fa1d3-2c19-478b-8a40-8916e00d46fb tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b7359e19-022e-4105-a712-82a7ccf5f460 req-022fa1d3-2c19-478b-8a40-8916e00d46fb tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b7359e19-022e-4105-a712-82a7ccf5f460 req-022fa1d3-2c19-478b-8a40-8916e00d46fb tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-b7359e19-022e-4105-a712-82a7ccf5f460 req-022fa1d3-2c19-478b-8a40-8916e00d46fb tempest-ServerActionsTestOtherA-98116980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-04664867-debd-4d3c-9c79-607ab079d4ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89a0c90b-af59-4652-9834-509259c8521c', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:03:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-b7359e19-022e-4105-a712-82a7ccf5f460 req-022fa1d3-2c19-478b-8a40-8916e00d46fb tempest-ServerActionsTestOtherA-98116980 None] attachment_update completed successfully. Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Flow 'volume_create_manager' (25e338b3-7331-40da-bdf9-27a1ab9d9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e73549-92a4-4846-a1aa-f1685b83788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e73549-92a4-4846-a1aa-f1685b83788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-145004096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba46d51279f460695cec9bd134da4cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:34Z,use_quota=True,user_id='8ecc62edc4094327a6c7b4261a3fb895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2f9cfc-3f89-45e9-8e8b-a1bb133bc392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2f9cfc-3f89-45e9-8e8b-a1bb133bc392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b42640-14b9-48e6-88b9-3419340a4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:33 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:03:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b42640-14b9-48e6-88b9-3419340a4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72', 'volume_name': 'volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab37934-9cdf-4231-aede-04410fdf0be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab37934-9cdf-4231-aede-04410fdf0be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d98026-2431-4cc3-9012-fa9d3c1815be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Volume bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 15:03:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Trying to clone bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 from image a5728ae6-576a-47f4-a55c-199ed63578be at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:03:35 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:03:35 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Image download 20.69 MB at 20.69 MB/s Nov 05 15:03:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd5d39b-a2bb-40d3-bb81-c7aeca017390]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:35 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD Nov 05 15:03:35 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:35 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD" returned: 0 in 0.521s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:35 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be is fetched for user 8ecc62edc4094327a6c7b4261a3fb895. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4e969-ead7-47dd-8fc0-291de0dd0c7c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:36 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD Nov 05 15:03:36 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:36 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-145004096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba46d51279f460695cec9bd134da4cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:34Z,use_quota=True,user_id='8ecc62edc4094327a6c7b4261a3fb895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Creating volume bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:03:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:03:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:36 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 1073741824 Nov 05 15:03:36 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:37 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 1073741824" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-c1ec80b4-47e6-49b7-b882-6f8b20196569 tempest-ServerActionsTestOtherA-98116980 None] Terminate volume connection completed successfully. Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-c1ec80b4-47e6-49b7-b882-6f8b20196569 tempest-ServerActionsTestOtherA-98116980 None] Deleting attachment 89a0c90b-af59-4652-9834-509259c8521c. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:03:37 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 Nov 05 15:03:37 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:37 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" returned: 0 in 0.579s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:37 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Attempting download of a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bcb2fa-71ad-44c8-8919-ae4c8d4baa14]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:38 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z Nov 05 15:03:38 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-3033432d-a31d-4cad-88d9-a60e8a667006 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-3033432d-a31d-4cad-88d9-a60e8a667006 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-3033432d-a31d-4cad-88d9-a60e8a667006 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:38 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z" returned: 0 in 0.587s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-3033432d-a31d-4cad-88d9-a60e8a667006 tempest-ServerActionsTestOtherA-98116980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-04664867-debd-4d3c-9c79-607ab079d4ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0b7c12f-9e21-49af-889b-f55edd9e2357', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:03:38 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z Nov 05 15:03:38 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a6a32c7c-3d77-4953-baa3-f0651355759d req-3033432d-a31d-4cad-88d9-a60e8a667006 tempest-ServerActionsTestOtherA-98116980 None] attachment_update completed successfully. Nov 05 15:03:39 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z" returned: 1 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be__0noie1z' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b5baa6-1974-437b-98ae-6982fbad3652]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:39 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:03:39 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:39 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD Nov 05 15:03:39 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:39 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:03:39 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] a5728ae6-576a-47f4-a55c-199ed63578be was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:03:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:39 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 Nov 05 15:03:39 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:42 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" returned: 0 in 3.027s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:42 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_h8p3n3gsdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:03:42 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Converted 112.00 MB image at 36.95 MB/s Nov 05 15:03:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:42 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 1G Nov 05 15:03:42 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:43 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 1G" returned: 0 in 0.528s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Downloaded image a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be for user 8ecc62edc4094327a6c7b4261a3fb895 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Marking volume bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Copying metadata from image a5728ae6-576a-47f4-a55c-199ed63578be to bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Creating volume glance metadata for volume bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 backed by image a5728ae6-576a-47f4-a55c-199ed63578be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d98026-2431-4cc3-9012-fa9d3c1815be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48b0809-72c6-48a8-86b0-a948afdc070f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Volume volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 (bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72): created successfully Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48b0809-72c6-48a8-86b0-a948afdc070f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Flow 'volume_create_manager' (25e338b3-7331-40da-bdf9-27a1ab9d9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-abef823a-24a7-4b6d-b97b-e54f709034e4 tempest-VolumesImageMetadata-687713323 None] Created volume successfully. Nov 05 15:03:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Acquiring lock "cinder-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Lock "cinder-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Acquiring lock "cinder-quobyte-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Lock "cinder-quobyte-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[197b599b-c557-4dc2-8042-58f5b201271f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:44 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 Nov 05 15:03:44 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:45 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" returned: 0 in 0.464s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:45 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72 Nov 05 15:03:45 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:45 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Lock "cinder-quobyte-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72" released by "delete_volume" :: held 0.855s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Created reservations ['702ef79d-43dd-4f00-8e40-8b9276c17519', '36489f26-503d-4248-bb0f-f20917dfc299', 'a5e08a13-e655-4e7c-949f-2159592e1b39', '4f8929e0-0d05-49cc-a600-6cf24d0cf711'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:45 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:03:45 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:46 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:03:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Deleted volume successfully. Nov 05 15:03:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d6f4066-1f8b-417a-962f-578dde0e1f5e tempest-VolumesImageMetadata-687713323 None] Lock "cinder-bcdc3cf9-5eba-4fe4-8ba0-84cc68197e72-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Flow 'volume_create_manager' (57277ee0-7a4d-4d4c-a6a5-068eb59dd896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85ffc37-01c7-493f-8f84-e73885425cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85ffc37-01c7-493f-8f84-e73885425cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1314952696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99406ffb-594f-4855-9a72-08b26e922499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51e08b5b90f496ebeccabdcc8f8e06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:51Z,use_quota=True,user_id='82912eef3c114d759c69b958f47aa3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9577e2-4bdf-48fc-b263-e94391c9a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9577e2-4bdf-48fc-b263-e94391c9a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bde03d-6bfb-4c8c-b05e-c4469b6ad7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bde03d-6bfb-4c8c-b05e-c4469b6ad7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99406ffb-594f-4855-9a72-08b26e922499', 'volume_name': 'volume-99406ffb-594f-4855-9a72-08b26e922499', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f13043-8ed0-477d-a3e7-dc20983692d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f13043-8ed0-477d-a3e7-dc20983692d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48217c95-a0fc-4123-a6de-7c97ae025549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Volume 99406ffb-594f-4855-9a72-08b26e922499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99406ffb-594f-4855-9a72-08b26e922499', 'volume_size': 1} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1314952696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99406ffb-594f-4855-9a72-08b26e922499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51e08b5b90f496ebeccabdcc8f8e06c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:51Z,use_quota=True,user_id='82912eef3c114d759c69b958f47aa3d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Creating volume 99406ffb-594f-4855-9a72-08b26e922499 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:03:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:03:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:50 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 1073741824 Nov 05 15:03:50 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:51 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 1073741824" returned: 0 in 0.591s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:51 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 Nov 05 15:03:51 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:51 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48217c95-a0fc-4123-a6de-7c97ae025549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99406ffb-594f-4855-9a72-08b26e922499', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d95d55d-28d9-45fa-afd5-5ce129087d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Volume volume-99406ffb-594f-4855-9a72-08b26e922499 (99406ffb-594f-4855-9a72-08b26e922499): created successfully Nov 05 15:03:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d95d55d-28d9-45fa-afd5-5ce129087d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Flow 'volume_create_manager' (57277ee0-7a4d-4d4c-a6a5-068eb59dd896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6355d2a8-de0f-4459-86ed-ce3e5a3575b0 tempest-AttachVolumeShelveTestJSON-349796503 None] Created volume successfully. Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Flow 'volume_create_manager' (91d0876c-5e26-4acc-ad53-9934fede5079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9887b5f-8a0a-4547-8473-f1deb70d2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9887b5f-8a0a-4547-8473-f1deb70d2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1169550872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acccf685-f58e-4129-ae37-057b20354eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5569944bfabf4757b5d22bfd9fbf4ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:53Z,use_quota=True,user_id='ce13ffcd1f4c4d3fbe9165e2ec971881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737f0c4d-00ee-44fa-b0c4-c59cdcfbd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737f0c4d-00ee-44fa-b0c4-c59cdcfbd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6be953-fd58-4244-b575-1ff47d014e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc6be953-fd58-4244-b575-1ff47d014e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acccf685-f58e-4129-ae37-057b20354eeb', 'volume_name': 'volume-acccf685-f58e-4129-ae37-057b20354eeb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e5e387-abf7-4d57-98d4-f3f4cb2090a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e5e387-abf7-4d57-98d4-f3f4cb2090a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af7e45b-0feb-435d-902e-4332775ccdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Volume acccf685-f58e-4129-ae37-057b20354eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acccf685-f58e-4129-ae37-057b20354eeb', 'volume_size': 1} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1169550872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acccf685-f58e-4129-ae37-057b20354eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5569944bfabf4757b5d22bfd9fbf4ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:53Z,use_quota=True,user_id='ce13ffcd1f4c4d3fbe9165e2ec971881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Creating volume acccf685-f58e-4129-ae37-057b20354eeb {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:03:53 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:03:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:53 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb 1073741824 Nov 05 15:03:53 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:54 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb 1073741824" returned: 0 in 0.511s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:54 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb Nov 05 15:03:54 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:54 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af7e45b-0feb-435d-902e-4332775ccdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acccf685-f58e-4129-ae37-057b20354eeb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b68a07-e128-4dd2-ac1e-d67e41ed5e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Volume volume-acccf685-f58e-4129-ae37-057b20354eeb (acccf685-f58e-4129-ae37-057b20354eeb): created successfully Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b68a07-e128-4dd2-ac1e-d67e41ed5e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Flow 'volume_create_manager' (91d0876c-5e26-4acc-ad53-9934fede5079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0df611a9-9a22-4484-a382-be71a82cc311 tempest-VolumeQuotasAdminTestJSON-1175966093 None] Created volume successfully. Nov 05 15:03:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "cinder-acccf685-f58e-4129-ae37-057b20354eeb-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "cinder-acccf685-f58e-4129-ae37-057b20354eeb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "cinder-quobyte-acccf685-f58e-4129-ae37-057b20354eeb" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:03:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "cinder-quobyte-acccf685-f58e-4129-ae37-057b20354eeb" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:03:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee780dc3-4054-489a-9fdf-9fbd96c3f5d2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:03:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:56 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb Nov 05 15:03:56 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:56 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:56 devstack sudo[91487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb Nov 05 15:03:56 devstack sudo[91487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:56 devstack sudo[91487]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-acccf685-f58e-4129-ae37-057b20354eeb" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "cinder-quobyte-acccf685-f58e-4129-ae37-057b20354eeb" released by "delete_volume" :: held 0.807s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Created reservations ['38c29747-2748-498e-a845-f91e9e3c646a', 'a913aa89-07d4-4e12-a1d3-4e209dae33de', 'f83d5e51-5e4e-419c-b9a7-1b53b789028e', '8b03df6c-e291-4067-8777-4296e29c082e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:56 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:03:56 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:57 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:03:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Deleted volume successfully. Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7bf67652-87f9-42e0-ad53-7dbd764a8baa tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "cinder-acccf685-f58e-4129-ae37-057b20354eeb-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Flow 'volume_create_manager' (8d360c20-0aae-4096-ba92-8f1535ed6a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c67bc28-73c5-4d24-8400-160318dce438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c67bc28-73c5-4d24-8400-160318dce438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-188252524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154055f2-52dd-4911-b08e-828906862c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a609f778064fa487ceecc87e652d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:58Z,use_quota=True,user_id='5a07003915664fd0996c5f265f73a76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd640518-158c-4820-a94d-1ff928cf3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd640518-158c-4820-a94d-1ff928cf3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42204f55-f2c3-4c6c-8135-03b666b694e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42204f55-f2c3-4c6c-8135-03b666b694e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154055f2-52dd-4911-b08e-828906862c41', 'volume_name': 'volume-154055f2-52dd-4911-b08e-828906862c41', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970c185e-5763-43a7-979d-201bec5f5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970c185e-5763-43a7-979d-201bec5f5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3abdc5-3e00-405b-9ef5-7044460cab6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Volume 154055f2-52dd-4911-b08e-828906862c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154055f2-52dd-4911-b08e-828906862c41', 'volume_size': 1} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-188252524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154055f2-52dd-4911-b08e-828906862c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a609f778064fa487ceecc87e652d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:58Z,use_quota=True,user_id='5a07003915664fd0996c5f265f73a76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Creating volume 154055f2-52dd-4911-b08e-828906862c41 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:03:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:57 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 1073741824 Nov 05 15:03:57 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Flow 'volume_create_manager' (60bf5390-f812-40f1-af26-adc8fcee6962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074c9525-2d65-4548-b110-8a1515fdb336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (074c9525-2d65-4548-b110-8a1515fdb336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1614237037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4c5c05-5cbf-4bf4-aafe-4e63427d696a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5569944bfabf4757b5d22bfd9fbf4ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:58Z,use_quota=True,user_id='ce13ffcd1f4c4d3fbe9165e2ec971881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251e432-286c-419f-9390-888113aebd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1251e432-286c-419f-9390-888113aebd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83792b66-74f0-4034-80ca-35f68df584c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83792b66-74f0-4034-80ca-35f68df584c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f4c5c05-5cbf-4bf4-aafe-4e63427d696a', 'volume_name': 'volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3eed96-acac-424a-9db4-0454d2eb1167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3eed96-acac-424a-9db4-0454d2eb1167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90acc24d-d249-4ae7-bd4a-b67867f42498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Volume 6f4c5c05-5cbf-4bf4-aafe-4e63427d696a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a', 'volume_size': 1} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:58 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 1073741824" returned: 0 in 0.455s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:58 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 Nov 05 15:03:58 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:58 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1614237037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f4c5c05-5cbf-4bf4-aafe-4e63427d696a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5569944bfabf4757b5d22bfd9fbf4ed6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:03:58Z,use_quota=True,user_id='ce13ffcd1f4c4d3fbe9165e2ec971881',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Creating volume 6f4c5c05-5cbf-4bf4-aafe-4e63427d696a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:03:58 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:58 devstack sudo[91504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a 1073741824 Nov 05 15:03:58 devstack sudo[91504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3abdc5-3e00-405b-9ef5-7044460cab6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154055f2-52dd-4911-b08e-828906862c41', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4806aa-ca76-40a6-a6e5-f466c2128d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Volume volume-154055f2-52dd-4911-b08e-828906862c41 (154055f2-52dd-4911-b08e-828906862c41): created successfully Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4806aa-ca76-40a6-a6e5-f466c2128d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Flow 'volume_create_manager' (8d360c20-0aae-4096-ba92-8f1535ed6a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2ed18254-ac5b-4f73-931f-45395d0736f0 tempest-VolumesTransfersV355Test-1227182294 None] Created volume successfully. Nov 05 15:03:59 devstack sudo[91504]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a 1073741824" returned: 0 in 0.473s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:03:59 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a Nov 05 15:03:59 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:03:59 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90acc24d-d249-4ae7-bd4a-b67867f42498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516ab731-57d9-4be9-9b10-ed3df3eaf93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:03:59 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Volume volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a (6f4c5c05-5cbf-4bf4-aafe-4e63427d696a): created successfully Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516ab731-57d9-4be9-9b10-ed3df3eaf93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:03:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Flow 'volume_create_manager' (60bf5390-f812-40f1-af26-adc8fcee6962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:03:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-94ef4018-b039-4a18-b465-32b91724858a tempest-VolumeQuotasAdminTestJSON-1175966093 None] Created volume successfully. Nov 05 15:04:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b4c26e04-5415-471b-b437-87910f0f36f2 tempest-VolumesTransfersV355Test-433438381 None] Transfer volume completed successfully. Nov 05 15:04:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-23f75581-8a31-44eb-af15-b81188b9bb52 tempest-VolumeQuotasAdminTestJSON-838079747 None] Transfer volume completed successfully. Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Acquiring lock "cinder-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Lock "cinder-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Acquiring lock "cinder-quobyte-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Lock "cinder-quobyte-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Acquiring lock "cinder-154055f2-52dd-4911-b08e-828906862c41-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56ace7-dd5c-4307-aca8-222279d07256]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-154055f2-52dd-4911-b08e-828906862c41-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Acquiring lock "cinder-quobyte-154055f2-52dd-4911-b08e-828906862c41" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-quobyte-154055f2-52dd-4911-b08e-828906862c41" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3235a9a0-20f4-4862-89c0-bd231d2492c0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:01 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a Nov 05 15:04:01 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:01 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 Nov 05 15:04:01 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:01 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:01 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a Nov 05 15:04:01 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:01 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:01 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41 Nov 05 15:04:01 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:02 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a" returned: 0 in 0.272s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Lock "cinder-quobyte-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a" released by "delete_volume" :: held 0.748s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Created reservations ['66771238-24f3-42d4-ae59-d9236ff5e5c4', '027c4581-0af0-41c8-9b2b-fa9383d94072', '0f64fe5c-cbb5-464c-8570-49664dad65c9', '30463c5e-22b7-47fe-86be-6a1075138975'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:02 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-154055f2-52dd-4911-b08e-828906862c41" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-quobyte-154055f2-52dd-4911-b08e-828906862c41" released by "delete_volume" :: held 0.800s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-f18eda9d-1a5e-4a81-9703-deaf784fccae req-61e8242a-fd27-4c43-945e-571a17dded21 tempest-AttachVolumeShelveTestJSON-349796503 None] No connector for attachment cc6c9246-41cb-408f-a448-ce1b47fd49af; skipping storage backend terminate_connection call. {{(pid=87126) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-f18eda9d-1a5e-4a81-9703-deaf784fccae req-61e8242a-fd27-4c43-945e-571a17dded21 tempest-AttachVolumeShelveTestJSON-349796503 None] Deleting attachment cc6c9246-41cb-408f-a448-ce1b47fd49af. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:02 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:02 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Created reservations ['ce58c2cb-cfe9-4f70-ae6b-c579e03283c8', '00b2189a-b932-490e-bae2-cba19db026eb', 'db3dee00-17a6-4483-a4c5-a1d749a213ac', 'c71cdf46-3da3-498c-888a-635cf34dbe06'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:02 devstack sudo[91579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:02 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:02 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.521s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Deleted volume successfully. Nov 05 15:04:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e8180a39-bd02-4a33-b0e3-4a589932ca35 tempest-VolumeQuotasAdminTestJSON-1818449642 None] Lock "cinder-6f4c5c05-5cbf-4bf4-aafe-4e63427d696a-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:03 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.424s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:03 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Deleted volume successfully. Nov 05 15:04:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b60a2933-b892-4ea5-a6c8-8b0512a4ae8b tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-154055f2-52dd-4911-b08e-828906862c41-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Flow 'volume_create_manager' (63e8b123-b0e1-4d96-9221-176592381f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a3b766-ac8d-41fa-8911-1ce57a282666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a3b766-ac8d-41fa-8911-1ce57a282666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-54881438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a937290-2e84-4fb3-99ac-f005b0a8eb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a609f778064fa487ceecc87e652d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:04Z,use_quota=True,user_id='5a07003915664fd0996c5f265f73a76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6de54cf-5b71-4ac1-ab63-211823e441eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6de54cf-5b71-4ac1-ab63-211823e441eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af03709-8a22-410a-9bac-ae7f362f0de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af03709-8a22-410a-9bac-ae7f362f0de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a937290-2e84-4fb3-99ac-f005b0a8eb98', 'volume_name': 'volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d5a20-45d4-4c91-afed-b884caa17c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28d5a20-45d4-4c91-afed-b884caa17c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69e1a3a-e0fe-4b0d-8f38-692dafe7a2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Volume 6a937290-2e84-4fb3-99ac-f005b0a8eb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98', 'volume_size': 1} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-54881438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a937290-2e84-4fb3-99ac-f005b0a8eb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85a609f778064fa487ceecc87e652d80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:04Z,use_quota=True,user_id='5a07003915664fd0996c5f265f73a76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Creating volume 6a937290-2e84-4fb3-99ac-f005b0a8eb98 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:04:04 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:04:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:04 devstack sudo[91586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 1073741824 Nov 05 15:04:04 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:05 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 1073741824" returned: 0 in 0.658s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:05 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 Nov 05 15:04:05 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:05 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69e1a3a-e0fe-4b0d-8f38-692dafe7a2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbedb21-8cd8-4b6c-be57-f169d4bb6166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Volume volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 (6a937290-2e84-4fb3-99ac-f005b0a8eb98): created successfully Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbedb21-8cd8-4b6c-be57-f169d4bb6166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Flow 'volume_create_manager' (63e8b123-b0e1-4d96-9221-176592381f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5c0758a0-80e8-4474-8986-18abca41ddd2 tempest-VolumesTransfersV355Test-1227182294 None] Created volume successfully. Nov 05 15:04:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Acquiring lock "cinder-6a937290-2e84-4fb3-99ac-f005b0a8eb98-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-6a937290-2e84-4fb3-99ac-f005b0a8eb98-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Acquiring lock "cinder-quobyte-6a937290-2e84-4fb3-99ac-f005b0a8eb98" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-quobyte-6a937290-2e84-4fb3-99ac-f005b0a8eb98" acquired by "delete_volume" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16bf49-2c80-4743-9a4d-a799709335d8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:07 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 Nov 05 15:04:07 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:07 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98" returned: 0 in 0.552s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:07 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98 Nov 05 15:04:07 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:07 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6a937290-2e84-4fb3-99ac-f005b0a8eb98" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-quobyte-6a937290-2e84-4fb3-99ac-f005b0a8eb98" released by "delete_volume" :: held 0.986s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Created reservations ['f88c90f3-42bf-4c29-8336-2f31e537416d', 'bc72363a-6bdc-4137-a9b5-4797b25f98ec', '95455b3f-eff1-4572-a30d-8ff578dda341', '27578d8c-18a6-4750-82b6-eb0f7f60b824'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:08 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:08 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-58fba33c-6269-42f9-b0bb-64110a6d4757 req-0d1f3622-ea78-4f17-98d1-8431a46b454a tempest-ServerActionsTestOtherA-98116980 None] Terminate volume connection completed successfully. Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-58fba33c-6269-42f9-b0bb-64110a6d4757 req-0d1f3622-ea78-4f17-98d1-8431a46b454a tempest-ServerActionsTestOtherA-98116980 None] Deleting attachment d0b7c12f-9e21-49af-889b-f55edd9e2357. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:04:08 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.574s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Deleted volume successfully. Nov 05 15:04:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1e917bb7-954c-46d1-92a6-14db74e996b7 tempest-VolumesTransfersV355Test-818305096 None] Lock "cinder-6a937290-2e84-4fb3-99ac-f005b0a8eb98-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:17 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=81,cinder:INSERT=28,cinder:UPDATE=81,cinder:DELETE=9 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:04:17 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=84,cinder:INSERT=25,cinder:UPDATE=96,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:04:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:04:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Flow 'volume_create_manager' (bb7671a3-6585-4b3f-8370-b2a1d7243e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ee1685-a291-4432-9a5e-a8da6df45edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ee1685-a291-4432-9a5e-a8da6df45edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-106200207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20b0e72-a832-4c03-82eb-64810d5d4ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c048d1d8fcd45539540d0b0b8160988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:18Z,use_quota=True,user_id='036f4d818c8a40638dc763e32a19310e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81606048-fa84-4f70-bab7-7f558a4182d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81606048-fa84-4f70-bab7-7f558a4182d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ad0aaf-2ccd-4930-8cef-c41dd6d4c9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ad0aaf-2ccd-4930-8cef-c41dd6d4c9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b20b0e72-a832-4c03-82eb-64810d5d4ce6', 'volume_name': 'volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eb404c-fe69-4781-9a55-fb0e288fe082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5eb404c-fe69-4781-9a55-fb0e288fe082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2166c528-cd10-4e9f-99d4-07bcb17cfd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Volume b20b0e72-a832-4c03-82eb-64810d5d4ce6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 15:04:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Trying to clone b20b0e72-a832-4c03-82eb-64810d5d4ce6 from image a5728ae6-576a-47f4-a55c-199ed63578be at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:04:19 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:04:19 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Image download 20.69 MB at 20.69 MB/s Nov 05 15:04:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[76786656-6bc9-4ec7-ad90-a16d57b8ef12]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:19 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD Nov 05 15:04:19 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:20 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be is fetched for user 036f4d818c8a40638dc763e32a19310e. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d350ef49-9f2c-4bd6-88af-c655c213a3bf]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:20 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD Nov 05 15:04:20 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:20 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-106200207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20b0e72-a832-4c03-82eb-64810d5d4ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c048d1d8fcd45539540d0b0b8160988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:18Z,use_quota=True,user_id='036f4d818c8a40638dc763e32a19310e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Creating volume b20b0e72-a832-4c03-82eb-64810d5d4ce6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:04:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:04:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:20 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 1073741824 Nov 05 15:04:20 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Flow 'volume_create_manager' (24f87fe0-2328-444e-b8a1-8ee992e63331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d433e2-b970-4fb6-ac3c-6b0b684530a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d433e2-b970-4fb6-ac3c-6b0b684530a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1084840606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c70a7e8-dc0b-4b9a-8062-26fe77663692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f634384a216448cc95b8a4799678249e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:21Z,use_quota=True,user_id='4994da49aac54ddcbad04342f042aaab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c369308e-2644-46ce-b3cb-15bdb7646f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c369308e-2644-46ce-b3cb-15bdb7646f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd394366-87a1-4ec9-a4d3-fe0fd0074d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd394366-87a1-4ec9-a4d3-fe0fd0074d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c70a7e8-dc0b-4b9a-8062-26fe77663692', 'volume_name': 'volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c29831-93f2-4faf-8b69-c321e64ba39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c29831-93f2-4faf-8b69-c321e64ba39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae73b35-dd39-4e8e-936b-c739fc02db63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Volume 0c70a7e8-dc0b-4b9a-8062-26fe77663692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692', 'volume_size': 2} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:21 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 1073741824" returned: 0 in 0.571s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:21 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 Nov 05 15:04:21 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:21 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1084840606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c70a7e8-dc0b-4b9a-8062-26fe77663692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f634384a216448cc95b8a4799678249e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:21Z,use_quota=True,user_id='4994da49aac54ddcbad04342f042aaab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Creating volume 0c70a7e8-dc0b-4b9a-8062-26fe77663692 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:04:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 2147483648 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Attempting download of a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume b20b0e72-a832-4c03-82eb-64810d5d4ce6. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:04:21 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 2147483648 Nov 05 15:04:21 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec20ea25-74c5-4d6d-b765-c2083fadba0d]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:22 devstack sudo[91838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4 Nov 05 15:04:22 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:22 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:22 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 2147483648" returned: 0 in 0.668s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:22 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4 Nov 05 15:04:22 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:22 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 Nov 05 15:04:22 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:22 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4" returned: 1 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_xnrzm0m4' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb9d1f-d74d-43b3-be57-e8c8e7e67f8a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:22 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692" returned: 0 in 0.275s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae73b35-dd39-4e8e-936b-c739fc02db63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10a56e2-fba2-4c7d-9968-a2f1b04d684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Volume volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 (0c70a7e8-dc0b-4b9a-8062-26fe77663692): created successfully Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10a56e2-fba2-4c7d-9968-a2f1b04d684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Flow 'volume_create_manager' (24f87fe0-2328-444e-b8a1-8ee992e63331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3a40acd2-3835-4800-97f2-e3e4a615f798 tempest-VolumesCloneNegativeTest-2083127152 None] Created volume successfully. Nov 05 15:04:22 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD Nov 05 15:04:22 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:23 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] a5728ae6-576a-47f4-a55c-199ed63578be was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:23 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 Nov 05 15:04:23 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Acquiring lock "cinder-0c70a7e8-dc0b-4b9a-8062-26fe77663692-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Lock "cinder-0c70a7e8-dc0b-4b9a-8062-26fe77663692-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Acquiring lock "cinder-quobyte-0c70a7e8-dc0b-4b9a-8062-26fe77663692" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Lock "cinder-quobyte-0c70a7e8-dc0b-4b9a-8062-26fe77663692" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c6a8a0-2a87-4f2f-81ea-f509e2eb4175]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:23 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 Nov 05 15:04:23 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:24 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:24 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692 Nov 05 15:04:24 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:24 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0c70a7e8-dc0b-4b9a-8062-26fe77663692" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Lock "cinder-quobyte-0c70a7e8-dc0b-4b9a-8062-26fe77663692" released by "delete_volume" :: held 0.861s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Created reservations ['e312bcac-3875-4d69-abc9-9a1d55445b62', 'b270a063-dc34-49e7-a763-0fd2ab78f5ed', '0e4bf4f0-8d27-4f3a-b97b-2a44f227bebb', '36baf120-6ca7-49dc-b60d-c12c8927d390'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:24 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:24 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:25 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Deleted volume successfully. Nov 05 15:04:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03a52ec5-5ee6-4da0-8087-03daf13d5def tempest-VolumesCloneNegativeTest-2083127152 None] Lock "cinder-0c70a7e8-dc0b-4b9a-8062-26fe77663692-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:25 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6" returned: 0 in 2.640s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:25 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be__e27ml1zdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:04:25 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Converted 112.00 MB image at 42.40 MB/s Nov 05 15:04:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:25 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 1G Nov 05 15:04:25 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:26 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 1G" returned: 0 in 0.556s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Downloaded image a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume b20b0e72-a832-4c03-82eb-64810d5d4ce6 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be for user 036f4d818c8a40638dc763e32a19310e is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Marking volume b20b0e72-a832-4c03-82eb-64810d5d4ce6 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Copying metadata from image a5728ae6-576a-47f4-a55c-199ed63578be to b20b0e72-a832-4c03-82eb-64810d5d4ce6. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Creating volume glance metadata for volume b20b0e72-a832-4c03-82eb-64810d5d4ce6 backed by image a5728ae6-576a-47f4-a55c-199ed63578be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2166c528-cd10-4e9f-99d4-07bcb17cfd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10336415-3c0d-4c5e-814a-2d3f15ca669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Volume volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 (b20b0e72-a832-4c03-82eb-64810d5d4ce6): created successfully Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10336415-3c0d-4c5e-814a-2d3f15ca669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Flow 'volume_create_manager' (bb7671a3-6585-4b3f-8370-b2a1d7243e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-553fee4e-344c-4a77-abbf-5f5b9d28d79b tempest-ServerActionsTestOtherA-98116980 None] Created volume successfully. Nov 05 15:04:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-9848a7d0-5500-4b16-b3f4-01e3c79a699b req-a91a32d4-5d40-4fca-841e-4df5d1d53503 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-9848a7d0-5500-4b16-b3f4-01e3c79a699b req-a91a32d4-5d40-4fca-841e-4df5d1d53503 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-9848a7d0-5500-4b16-b3f4-01e3c79a699b req-a91a32d4-5d40-4fca-841e-4df5d1d53503 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-9848a7d0-5500-4b16-b3f4-01e3c79a699b req-a91a32d4-5d40-4fca-841e-4df5d1d53503 tempest-ServerActionsTestOtherA-98116980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93843ac3-33f5-412f-9a69-de96d24f4232', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:04:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-9848a7d0-5500-4b16-b3f4-01e3c79a699b req-a91a32d4-5d40-4fca-841e-4df5d1d53503 tempest-ServerActionsTestOtherA-98116980 None] attachment_update completed successfully. Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Flow 'volume_create_manager' (cd7b72f7-0acb-442b-949d-92711ff59d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfa6e91-2602-48b4-b1c2-e24f6747a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfa6e91-2602-48b4-b1c2-e24f6747a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1385471624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219b600f-9632-4426-a582-0337614339ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53fc7d97157142ceb95fd39deaa5631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:36Z,use_quota=True,user_id='1f0f049e4ca948378ed0297c235888a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448df8ea-f6b0-413a-8931-b35ed29845bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448df8ea-f6b0-413a-8931-b35ed29845bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cdf456-5616-4738-b264-cfd83ea6a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4cdf456-5616-4738-b264-cfd83ea6a76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219b600f-9632-4426-a582-0337614339ac', 'volume_name': 'volume-219b600f-9632-4426-a582-0337614339ac', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfcb661-ade1-487d-bba3-661ba12610ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfcb661-ade1-487d-bba3-661ba12610ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f9dda2-d3fb-4732-b60a-37873edff0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Volume 219b600f-9632-4426-a582-0337614339ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219b600f-9632-4426-a582-0337614339ac', 'volume_size': 1} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1385471624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219b600f-9632-4426-a582-0337614339ac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53fc7d97157142ceb95fd39deaa5631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:36Z,use_quota=True,user_id='1f0f049e4ca948378ed0297c235888a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Creating volume 219b600f-9632-4426-a582-0337614339ac {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:04:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:04:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:36 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac 1073741824 Nov 05 15:04:36 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:37 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac 1073741824" returned: 0 in 0.726s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:37 devstack sudo[92375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac Nov 05 15:04:37 devstack sudo[92375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:37 devstack sudo[92375]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f9dda2-d3fb-4732-b60a-37873edff0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219b600f-9632-4426-a582-0337614339ac', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fbc0ea-890d-4395-8608-1eecac4c6d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Volume volume-219b600f-9632-4426-a582-0337614339ac (219b600f-9632-4426-a582-0337614339ac): created successfully Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31fbc0ea-890d-4395-8608-1eecac4c6d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Flow 'volume_create_manager' (cd7b72f7-0acb-442b-949d-92711ff59d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-105b3c81-546e-4e4f-972a-2be5d3f5b2c0 tempest-VolumesListTestJSON-225323521 None] Created volume successfully. Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:39 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:39 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:39 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.597s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Flow 'volume_create_manager' (98924f07-22f3-4e10-b165-9e5f51471670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213f8c7-0931-49ad-8bcd-94b04ffec5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2213f8c7-0931-49ad-8bcd-94b04ffec5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-551273973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2aa909e-a3a5-4437-b53b-100413468041,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53fc7d97157142ceb95fd39deaa5631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:40Z,use_quota=True,user_id='1f0f049e4ca948378ed0297c235888a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b1200a-6c7f-4f9d-8e52-93174e3486b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b1200a-6c7f-4f9d-8e52-93174e3486b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6c602a-644f-42c3-aaf5-ad2f0782c7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6c602a-644f-42c3-aaf5-ad2f0782c7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2aa909e-a3a5-4437-b53b-100413468041', 'volume_name': 'volume-b2aa909e-a3a5-4437-b53b-100413468041', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d7f779-97b2-4c77-b20d-a2cdb152fc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d7f779-97b2-4c77-b20d-a2cdb152fc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8af88e8-849a-498f-ab91-08d8faf33e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Volume b2aa909e-a3a5-4437-b53b-100413468041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2aa909e-a3a5-4437-b53b-100413468041', 'volume_size': 1} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-551273973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2aa909e-a3a5-4437-b53b-100413468041,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53fc7d97157142ceb95fd39deaa5631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:40Z,use_quota=True,user_id='1f0f049e4ca948378ed0297c235888a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Creating volume b2aa909e-a3a5-4437-b53b-100413468041 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:04:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:04:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:40 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 1073741824 Nov 05 15:04:40 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:40 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 1073741824" returned: 0 in 0.709s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:40 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 Nov 05 15:04:40 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:41 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8af88e8-849a-498f-ab91-08d8faf33e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2aa909e-a3a5-4437-b53b-100413468041', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac7aa7-d89b-4e56-a522-4494c532a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Volume volume-b2aa909e-a3a5-4437-b53b-100413468041 (b2aa909e-a3a5-4437-b53b-100413468041): created successfully Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac7aa7-d89b-4e56-a522-4494c532a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Flow 'volume_create_manager' (98924f07-22f3-4e10-b165-9e5f51471670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-04becd2f-0fe7-4c43-a2c2-e75e9ec6175f tempest-VolumesListTestJSON-225323521 None] Created volume successfully. Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Flow 'volume_create_manager' (d2b5a16e-299d-4966-9e86-4ccc5c2d481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285f96df-4f03-4c9c-8530-db26f75aa73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285f96df-4f03-4c9c-8530-db26f75aa73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-654525532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8169a23f-d8e7-4436-a15c-bd033ac39ac0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53fc7d97157142ceb95fd39deaa5631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:43Z,use_quota=True,user_id='1f0f049e4ca948378ed0297c235888a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12967bb8-e073-423c-8754-1d28265d03ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12967bb8-e073-423c-8754-1d28265d03ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55e7223-a3da-456f-96a9-0af1bfa55e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55e7223-a3da-456f-96a9-0af1bfa55e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8169a23f-d8e7-4436-a15c-bd033ac39ac0', 'volume_name': 'volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14618f9e-92ce-445a-806d-16cf1e93ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14618f9e-92ce-445a-806d-16cf1e93ff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6470dea-c6e9-4142-8366-ba92b0a2436b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Volume 8169a23f-d8e7-4436-a15c-bd033ac39ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0', 'volume_size': 1} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-654525532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8169a23f-d8e7-4436-a15c-bd033ac39ac0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='53fc7d97157142ceb95fd39deaa5631c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:04:43Z,use_quota=True,user_id='1f0f049e4ca948378ed0297c235888a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Creating volume 8169a23f-d8e7-4436-a15c-bd033ac39ac0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:04:43 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:43 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 1073741824 Nov 05 15:04:43 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:43 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 1073741824" returned: 0 in 0.693s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:44 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 Nov 05 15:04:44 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:44 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0" returned: 0 in 0.559s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6470dea-c6e9-4142-8366-ba92b0a2436b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6d95dc-f029-4a01-91ba-3321a1e16033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:04:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Volume volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 (8169a23f-d8e7-4436-a15c-bd033ac39ac0): created successfully Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6d95dc-f029-4a01-91ba-3321a1e16033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:04:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Flow 'volume_create_manager' (d2b5a16e-299d-4966-9e86-4ccc5c2d481e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:04:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-15de7d62-93cd-4dcd-8faf-3e0f3879ea79 tempest-VolumesListTestJSON-225323521 None] Created volume successfully. Nov 05 15:04:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Acquiring lock "cinder-8169a23f-d8e7-4436-a15c-bd033ac39ac0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Lock "cinder-8169a23f-d8e7-4436-a15c-bd033ac39ac0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Acquiring lock "cinder-quobyte-8169a23f-d8e7-4436-a15c-bd033ac39ac0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Lock "cinder-quobyte-8169a23f-d8e7-4436-a15c-bd033ac39ac0" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7003d-aa19-4989-afc6-931e0d014b31]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:50 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 Nov 05 15:04:50 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:50 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0" returned: 0 in 0.790s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:50 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0 Nov 05 15:04:50 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:51 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8169a23f-d8e7-4436-a15c-bd033ac39ac0" returned: 0 in 0.535s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Lock "cinder-quobyte-8169a23f-d8e7-4436-a15c-bd033ac39ac0" released by "delete_volume" :: held 1.414s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Created reservations ['f8ed3584-916a-4753-a702-7d36fb2f1115', '5101ff15-8d2a-48ec-8a73-6ae594228156', '2af9b2db-b71d-4a9c-843d-0f8075092594', '327ad1f3-1f89-4b93-909a-a3b837ee83f2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:51 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:51 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:52 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.639s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Deleted volume successfully. Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ed7387ef-8199-46c4-bf84-5aabf914f23f tempest-VolumesListTestJSON-225323521 None] Lock "cinder-8169a23f-d8e7-4436-a15c-bd033ac39ac0-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Acquiring lock "cinder-b2aa909e-a3a5-4437-b53b-100413468041-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Lock "cinder-b2aa909e-a3a5-4437-b53b-100413468041-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Acquiring lock "cinder-quobyte-b2aa909e-a3a5-4437-b53b-100413468041" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Lock "cinder-quobyte-b2aa909e-a3a5-4437-b53b-100413468041" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae6bf8-d676-4c30-92e2-e50fbb2e7acd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:53 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 Nov 05 15:04:53 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Acquiring lock "cinder-99406ffb-594f-4855-9a72-08b26e922499-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "cinder-99406ffb-594f-4855-9a72-08b26e922499-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Acquiring lock "cinder-quobyte-99406ffb-594f-4855-9a72-08b26e922499" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "cinder-quobyte-99406ffb-594f-4855-9a72-08b26e922499" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2222980-9f7a-4f62-a6f0-e470e0ecb9ad]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:53 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041" returned: 0 in 1.024s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:53 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041 Nov 05 15:04:53 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:54 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 Nov 05 15:04:54 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:54 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b2aa909e-a3a5-4437-b53b-100413468041" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Lock "cinder-quobyte-b2aa909e-a3a5-4437-b53b-100413468041" released by "delete_volume" :: held 1.677s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Created reservations ['76a73689-41fc-4205-b458-a2b7e0d12d69', '092baa1d-a4f9-4aed-b295-ac25aca4acab', 'c9fb262c-5f75-4b06-80d8-ba31c800126d', '0fa51675-41a2-46d9-a4bf-bd0da39541c3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:54 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499" returned: 0 in 0.765s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:54 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499 Nov 05 15:04:54 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:54 devstack sudo[92475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:54 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:54 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-99406ffb-594f-4855-9a72-08b26e922499" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "cinder-quobyte-99406ffb-594f-4855-9a72-08b26e922499" released by "delete_volume" :: held 1.366s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:55 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.536s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Deleted volume successfully. Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Created reservations ['1fd9f2f2-2b86-4279-878d-ff9201cb12e5', '0eb21871-b23b-4192-8e93-b1a7f73596ae', '4c0239ba-5442-4ac7-a9d7-505eb804d509', '64d70e08-a665-46c1-892e-99a33442211d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "cinder-219b600f-9632-4426-a582-0337614339ac-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1a8575c-1955-4ca3-872a-7d9f19a0ec8c tempest-VolumesListTestJSON-225323521 None] Lock "cinder-b2aa909e-a3a5-4437-b53b-100413468041-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Lock "cinder-219b600f-9632-4426-a582-0337614339ac-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "cinder-quobyte-219b600f-9632-4426-a582-0337614339ac" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Lock "cinder-quobyte-219b600f-9632-4426-a582-0337614339ac" acquired by "delete_volume" :: waited 0.076s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:04:55 devstack sudo[92484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:55 devstack sudo[92484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[289ace82-56d7-4223-b392-59fe9eb2f084]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:55 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac Nov 05 15:04:55 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:55 devstack sudo[92484]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Deleted volume successfully. Nov 05 15:04:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-161855ad-f02b-45ca-bc03-2dfe7d82a0b9 tempest-AttachVolumeShelveTestJSON-349796503 None] Lock "cinder-99406ffb-594f-4855-9a72-08b26e922499-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:56 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac" returned: 0 in 0.677s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:56 devstack sudo[92522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac Nov 05 15:04:56 devstack sudo[92522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:56 devstack sudo[92522]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-219b600f-9632-4426-a582-0337614339ac" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Lock "cinder-quobyte-219b600f-9632-4426-a582-0337614339ac" released by "delete_volume" :: held 1.169s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Created reservations ['19c108c8-916f-402b-ac0b-687bfbada788', '3583842a-0f32-44b3-aaf5-1b766e1bd549', '46f48083-82c4-427d-8275-c40541cc4b2f', '46d9cb9f-2590-49ae-beb5-02a1cde173f3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:04:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:04:56 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:04:56 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:04:57 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Nov 05 15:04:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:04:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:04:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Deleted volume successfully. Nov 05 15:04:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5673380e-1729-4ac3-a400-0f95d557d147 tempest-VolumesListTestJSON-225323521 None] Lock "cinder-219b600f-9632-4426-a582-0337614339ac-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:04:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-be8e0764-cbb7-4159-8636-0d9705178fb4 tempest-ServerActionsTestOtherA-98116980 None] Terminate volume connection completed successfully. Nov 05 15:04:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-be8e0764-cbb7-4159-8636-0d9705178fb4 tempest-ServerActionsTestOtherA-98116980 None] Deleting attachment 93843ac3-33f5-412f-9a69-de96d24f4232. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:05:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-9ea267ae-5679-44b1-8d16-a9ac54550768 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-9ea267ae-5679-44b1-8d16-a9ac54550768 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-9ea267ae-5679-44b1-8d16-a9ac54550768 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-9ea267ae-5679-44b1-8d16-a9ac54550768 tempest-ServerActionsTestOtherA-98116980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a74b754-d03a-4bd5-acdd-c51ed1ec2f5b', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:05:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-3a9b2049-6a1c-4102-90d0-23769fe5d635 req-9ea267ae-5679-44b1-8d16-a9ac54550768 tempest-ServerActionsTestOtherA-98116980 None] attachment_update completed successfully. Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (7a979ebe-39fd-4fad-9724-c7beefc80499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c1c4ee-2db9-48d7-ad2b-432dc096576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c1c4ee-2db9-48d7-ad2b-432dc096576a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-225472420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50559af-968b-4958-94d1-ab4537f4cef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:10Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc59850-a441-42d4-9556-d75a46936fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc59850-a441-42d4-9556-d75a46936fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab3f296-ef94-450d-83cc-03cdf83a2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab3f296-ef94-450d-83cc-03cdf83a2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50559af-968b-4958-94d1-ab4537f4cef9', 'volume_name': 'volume-f50559af-968b-4958-94d1-ab4537f4cef9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abc1648-b088-4951-a013-36785fcea0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abc1648-b088-4951-a013-36785fcea0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b415d7cb-8d1c-4eb9-a554-95e616cda131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Volume f50559af-968b-4958-94d1-ab4537f4cef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50559af-968b-4958-94d1-ab4537f4cef9', 'volume_size': 1} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-225472420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50559af-968b-4958-94d1-ab4537f4cef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:10Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Creating volume f50559af-968b-4958-94d1-ab4537f4cef9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:09 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:10 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 1073741824 Nov 05 15:05:10 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:10 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 1073741824" returned: 0 in 1.008s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:11 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 Nov 05 15:05:11 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:11 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9" returned: 0 in 0.612s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b415d7cb-8d1c-4eb9-a554-95e616cda131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50559af-968b-4958-94d1-ab4537f4cef9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bb38c6-b729-414d-955c-a5cef3854ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Volume volume-f50559af-968b-4958-94d1-ab4537f4cef9 (f50559af-968b-4958-94d1-ab4537f4cef9): created successfully Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bb38c6-b729-414d-955c-a5cef3854ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (7a979ebe-39fd-4fad-9724-c7beefc80499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8d73d89c-1ad7-4206-9da2-546f7c57da00 tempest-VolumesActionsTest-1297437581 None] Created volume successfully. Nov 05 15:05:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f019ec2f-464d-428a-9422-bad9c0b47976 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9" by "attach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f019ec2f-464d-428a-9422-bad9c0b47976 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9" acquired by "attach_volume" :: waited 0.068s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f019ec2f-464d-428a-9422-bad9c0b47976 tempest-VolumesActionsTest-1297437581 None] Attaching volume f50559af-968b-4958-94d1-ab4537f4cef9 to instance 883b8486-b24a-4fe3-8593-823a034c1740 at mountpoint /dev/vdb on host None. Nov 05 15:05:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f019ec2f-464d-428a-9422-bad9c0b47976 tempest-VolumesActionsTest-1297437581 None] Attach volume completed successfully. Nov 05 15:05:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f019ec2f-464d-428a-9422-bad9c0b47976 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9" released by "attach_volume" :: held 0.468s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Flow 'volume_create_manager' (2b7ca9d9-86d4-4e37-bab5-d0559d0df4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7f73bd-6672-47f6-b79e-72afd628990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7f73bd-6672-47f6-b79e-72afd628990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1498342912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e33adf-9ca8-4909-b8be-721dea286c15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbc0ef110f43a59fe6c1b8d0a1848c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:15Z,use_quota=True,user_id='e238117ec64e4ad584d0e3b69fce0ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b387a97-3efd-429e-b162-b183af50ab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b387a97-3efd-429e-b162-b183af50ab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d95e68-cfb1-43ef-a7da-ad4fdfa5a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d95e68-cfb1-43ef-a7da-ad4fdfa5a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e33adf-9ca8-4909-b8be-721dea286c15', 'volume_name': 'volume-69e33adf-9ca8-4909-b8be-721dea286c15', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca65ad76-6b60-46fa-b795-36e5b07a5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca65ad76-6b60-46fa-b795-36e5b07a5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1f7daf-f95e-4c65-9566-e558fd9352dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Volume 69e33adf-9ca8-4909-b8be-721dea286c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e33adf-9ca8-4909-b8be-721dea286c15', 'volume_size': 1} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1498342912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e33adf-9ca8-4909-b8be-721dea286c15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4fbc0ef110f43a59fe6c1b8d0a1848c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:15Z,use_quota=True,user_id='e238117ec64e4ad584d0e3b69fce0ca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Creating volume 69e33adf-9ca8-4909-b8be-721dea286c15 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:15 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 1073741824 Nov 05 15:05:15 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a2025314-ca09-4518-84be-dec1eadef65e tempest-VolumesActionsTest-886674590 None] Terminate volume connection completed successfully. Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2025314-ca09-4518-84be-dec1eadef65e tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2025314-ca09-4518-84be-dec1eadef65e tempest-VolumesActionsTest-886674590 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a2025314-ca09-4518-84be-dec1eadef65e tempest-VolumesActionsTest-886674590 None] Detaching volume f50559af-968b-4958-94d1-ab4537f4cef9 from instance 883b8486-b24a-4fe3-8593-823a034c1740. Nov 05 15:05:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a2025314-ca09-4518-84be-dec1eadef65e tempest-VolumesActionsTest-886674590 None] Detach volume completed successfully. Nov 05 15:05:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2025314-ca09-4518-84be-dec1eadef65e tempest-VolumesActionsTest-886674590 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-detach_volume" released by "detach_volume" :: held 0.284s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:16 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 1073741824" returned: 0 in 1.174s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:16 devstack sudo[93136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 Nov 05 15:05:16 devstack sudo[93136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3ffb1601-2f78-45c1-8243-5cf78fcc5b41 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3ffb1601-2f78-45c1-8243-5cf78fcc5b41 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3ffb1601-2f78-45c1-8243-5cf78fcc5b41 tempest-VolumesActionsTest-1297437581 None] Volume detach called, but volume not attached. Nov 05 15:05:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3ffb1601-2f78-45c1-8243-5cf78fcc5b41 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-detach_volume" released by "detach_volume" :: held 0.052s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:17 devstack sudo[93136]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15" returned: 0 in 0.758s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1f7daf-f95e-4c65-9566-e558fd9352dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e33adf-9ca8-4909-b8be-721dea286c15', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d763e5d0-4e58-481d-8fcb-93a67b71850d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Volume volume-69e33adf-9ca8-4909-b8be-721dea286c15 (69e33adf-9ca8-4909-b8be-721dea286c15): created successfully Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d763e5d0-4e58-481d-8fcb-93a67b71850d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Flow 'volume_create_manager' (2b7ca9d9-86d4-4e37-bab5-d0559d0df4ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-453d7cb0-1435-4fd1-990f-2e649f922707 req-983cdc0e-dc9e-4a26-b58b-3e465db590f7 tempest-VolumesGetTestJSON-893662458 None] Created volume successfully. Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Acquiring lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Acquiring lock "cinder-quobyte-f50559af-968b-4958-94d1-ab4537f4cef9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Lock "cinder-quobyte-f50559af-968b-4958-94d1-ab4537f4cef9" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7905afef-fccd-428f-bd7f-fadc4aef0c7f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:17 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 Nov 05 15:05:17 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:18 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9" returned: 0 in 0.826s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:18 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9 Nov 05 15:05:18 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:19 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f50559af-968b-4958-94d1-ab4537f4cef9" returned: 0 in 0.731s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Lock "cinder-quobyte-f50559af-968b-4958-94d1-ab4537f4cef9" released by "delete_volume" :: held 1.665s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=70,cinder:UPDATE=68,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Acquiring lock "cinder-69e33adf-9ca8-4909-b8be-721dea286c15-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=70,cinder:INSERT=23,cinder:UPDATE=71,cinder:DELETE=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Lock "cinder-69e33adf-9ca8-4909-b8be-721dea286c15-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Acquiring lock "cinder-quobyte-69e33adf-9ca8-4909-b8be-721dea286c15" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Lock "cinder-quobyte-69e33adf-9ca8-4909-b8be-721dea286c15" acquired by "delete_volume" :: waited 0.048s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e145b-5c22-4540-8e2f-e30e2872e92d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Created reservations ['36f438c9-ee52-4aca-a1f5-ecf258492ce1', '116f803f-c132-402d-8a86-adca3cac4a3e', 'a5b2d6b2-51d1-4aae-9f35-91459f20fbf4', 'e26d13f3-4d59-4974-8cf7-9bb458b5840f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:19 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:19 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:20 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 Nov 05 15:05:20 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:20 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15" returned: 0 in 1.040s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:20 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 1.005s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Deleted volume successfully. Nov 05 15:05:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0ffc9660-f09a-4810-b865-f679f8190bae tempest-VolumesActionsTest-1297437581 None] Lock "cinder-f50559af-968b-4958-94d1-ab4537f4cef9-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:20 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15 Nov 05 15:05:20 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:21 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-69e33adf-9ca8-4909-b8be-721dea286c15" returned: 0 in 0.773s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Lock "cinder-quobyte-69e33adf-9ca8-4909-b8be-721dea286c15" released by "delete_volume" :: held 1.935s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:21 devstack cinder-volume[87126]: DEBUG cinder.quota [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Created reservations ['fe9732af-6a51-447f-89f5-ab8f6de97164', '16cda622-8945-42b1-98b3-e05f409e78b0', 'bc495c02-5b66-4729-9a3b-cd1b45f2d3c0', 'c50f874c-f13d-4bcd-9976-1025a9aace6b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:22 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:22 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:22 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.424s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG cinder.manager [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Deleted volume successfully. Nov 05 15:05:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-c238a3e8-ddff-4fbf-a836-019deb379c8a req-a8aa4fcb-c704-4ba9-a226-fd0493e1b6f2 tempest-VolumesGetTestJSON-893662458 None] Lock "cinder-69e33adf-9ca8-4909-b8be-721dea286c15-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (0791e469-5462-42b4-b787-552c76c61564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f514330-fda8-49e9-aaa2-aa30a565f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f514330-fda8-49e9-aaa2-aa30a565f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1130169286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:25Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d81bb-c9c4-401e-acb6-98382d7a9f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd7d81bb-c9c4-401e-acb6-98382d7a9f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fe569-4bfd-47d8-8bd6-8601c35fa88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1fe569-4bfd-47d8-8bd6-8601c35fa88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5', 'volume_name': 'volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab5ad99-03dc-4000-a6af-6d2cbd05e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab5ad99-03dc-4000-a6af-6d2cbd05e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61acf008-b35d-4714-8620-f738926c5caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Volume 571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5', 'volume_size': 1} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1130169286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:25Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Creating volume 571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:25 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:25 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 1073741824 Nov 05 15:05:25 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:25 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 1073741824" returned: 0 in 0.662s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:26 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 Nov 05 15:05:26 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:26 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (59fa2e49-4b8d-4969-9f48-abcc87be8d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7354b31b-ed1e-462d-bab9-30b45633b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61acf008-b35d-4714-8620-f738926c5caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0391f2b4-f01e-400e-97f8-143f71fa19ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7354b31b-ed1e-462d-bab9-30b45633b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175536056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e077c2f-c383-4cd8-95ce-6f6e39422347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:26Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e28dbbe-2b38-43b6-b29c-97f7f4878f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e28dbbe-2b38-43b6-b29c-97f7f4878f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e2edcd-0dc1-49dd-9597-c2b157065923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e2edcd-0dc1-49dd-9597-c2b157065923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e077c2f-c383-4cd8-95ce-6f6e39422347', 'volume_name': 'volume-4e077c2f-c383-4cd8-95ce-6f6e39422347', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6172a4d-e4fc-4fcc-a836-2774ff424a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6172a4d-e4fc-4fcc-a836-2774ff424a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f95258-5141-4dbb-a6a9-96547266f1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Volume 4e077c2f-c383-4cd8-95ce-6f6e39422347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e077c2f-c383-4cd8-95ce-6f6e39422347', 'volume_size': 1} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175536056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e077c2f-c383-4cd8-95ce-6f6e39422347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:26Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Creating volume 4e077c2f-c383-4cd8-95ce-6f6e39422347 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:26 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Volume volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 (571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5): created successfully Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0391f2b4-f01e-400e-97f8-143f71fa19ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (0791e469-5462-42b4-b787-552c76c61564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:26 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 1073741824 Nov 05 15:05:26 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c6cde86f-0b28-4197-9b50-12592d2c941f tempest-VolumesSnapshotTestJSON-1455134048 None] Created volume successfully. Nov 05 15:05:26 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 1073741824" returned: 0 in 0.523s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:27 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 Nov 05 15:05:27 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:27 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f95258-5141-4dbb-a6a9-96547266f1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e077c2f-c383-4cd8-95ce-6f6e39422347', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb16891-91ba-427e-b39e-ecfd56d28771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Volume volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 (4e077c2f-c383-4cd8-95ce-6f6e39422347): created successfully Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb16891-91ba-427e-b39e-ecfd56d28771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (59fa2e49-4b8d-4969-9f48-abcc87be8d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6d99c998-6811-4eeb-8e84-b3458f5373e8 tempest-VolumesActionsTest-1297437581 None] Created volume successfully. Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Creating offline snapshot 104420ba-026f-432b-8dad-4bbd392a35fb of volume 571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[29540ef0-0985-4df6-9d00-a61f5c01f36f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:28 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 Nov 05 15:05:28 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-4e077c2f-c383-4cd8-95ce-6f6e39422347-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Lock "cinder-4e077c2f-c383-4cd8-95ce-6f6e39422347-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:28 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" returned: 0 in 0.685s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:28 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb 1G Nov 05 15:05:28 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-quobyte-4e077c2f-c383-4cd8-95ce-6f6e39422347" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-4e077c2f-c383-4cd8-95ce-6f6e39422347" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5029e59d-a1fd-4980-8d03-4e2a2b76959c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:29 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 Nov 05 15:05:29 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:29 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb 1G" returned: 0 in 0.526s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:29 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb Nov 05 15:05:29 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:29 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347" returned: 0 in 0.528s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:29 devstack sudo[93355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347 Nov 05 15:05:29 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:29 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb" returned: 0 in 0.421s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:29 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb is being set with open permissions: ugo+rw Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:29 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4e077c2f-c383-4cd8-95ce-6f6e39422347" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-4e077c2f-c383-4cd8-95ce-6f6e39422347" released by "delete_volume" :: held 0.920s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:29 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb Nov 05 15:05:29 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Created reservations ['3920c4a4-f3c3-46c8-a6ad-83a2da3586e4', '20abc176-2736-4cda-905e-0602ce58ca94', 'a9c03afd-38c3-4ef2-9021-2f1694603011', 'b3245e96-0e99-4dc6-82c1-8f67d0b4f3d9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:29 devstack sudo[93364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:29 devstack sudo[93364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:29 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:30 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info Nov 05 15:05:30 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:30 devstack sudo[93364]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Deleted volume successfully. Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-818a7e4a-02dd-467c-9a85-c02f8e87bdae tempest-VolumesActionsTest-886674590 None] Lock "cinder-4e077c2f-c383-4cd8-95ce-6f6e39422347-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:30 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:30 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info is being set with open permissions: ugo+rw Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:30 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info Nov 05 15:05:30 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:30 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.info" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ec2a984-3669-4029-8442-0648bf9fea19 tempest-VolumesSnapshotTestJSON-1455134048 None] Create snapshot completed successfully Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-104420ba-026f-432b-8dad-4bbd392a35fb-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-104420ba-026f-432b-8dad-4bbd392a35fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-104420ba-026f-432b-8dad-4bbd392a35fb" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-104420ba-026f-432b-8dad-4bbd392a35fb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Deleting offline snapshot 104420ba-026f-432b-8dad-4bbd392a35fb of volume 571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] snapshot_file for this snap is: volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[342b30ad-ebf3-4ef9-a71c-e8d603417aff]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (eaf1bb3f-0193-49c5-8883-2cd51dff5f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0387b6d3-68f2-4bf5-b56a-7aba6f2f355a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0387b6d3-68f2-4bf5-b56a-7aba6f2f355a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496462344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:31Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3514fc9a-e455-4b12-b9fb-5adf691524c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:31 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb Nov 05 15:05:31 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3514fc9a-e455-4b12-b9fb-5adf691524c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f289a771-d57d-4911-b2b8-9543e8ce17cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f289a771-d57d-4911-b2b8-9543e8ce17cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e', 'volume_name': 'volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7c8dd6-5861-45a4-9f69-e03f0f7c5f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7c8dd6-5861-45a4-9f69-e03f0f7c5f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d4a601-fa20-4975-a680-92a2a6813591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Volume 4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e', 'volume_size': 1} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-496462344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:31Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Creating volume 4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:31 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:31 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e 1073741824 Nov 05 15:05:31 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:31 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6748968b-0efd-41be-85b5-74de1ddac373]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:32 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 Nov 05 15:05:32 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:32 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e 1073741824" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:32 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e Nov 05 15:05:32 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:32 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" returned: 0 in 0.396s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:32 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb Nov 05 15:05:32 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:32 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d4a601-fa20-4975-a680-92a2a6813591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb741b8e-27cb-49ec-8869-6f367cab53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Volume volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e (4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e): created successfully Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb741b8e-27cb-49ec-8869-6f367cab53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (eaf1bb3f-0193-49c5-8883-2cd51dff5f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-33e7150f-0cb6-44c3-859f-8c08ca42c97f tempest-VolumesActionsTest-1297437581 None] Created volume successfully. Nov 05 15:05:32 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:32 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb Nov 05 15:05:32 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f23f8d0-cc9d-44c6-8e36-dedd3e8aba40 tempest-BackendsCapabilitiesAdminTestsJSON-680502392 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-99b9f51f-723a-4960-849d-2f1f9bac9c16 tempest-BackendsCapabilitiesAdminTestsJSON-680502392 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 15:05:32 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5.104420ba-026f-432b-8dad-4bbd392a35fb" returned: 0 in 0.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-104420ba-026f-432b-8dad-4bbd392a35fb" released by "_delete_snapshot" :: held 1.566s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" released by "delete_snapshot" :: held 1.592s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['72cd7163-0948-4bc4-b38a-386188677b01', '0076dbec-7e10-43d5-8395-1a2592d5ea1a', 'cf54e374-3702-46e2-927d-5c642c913742', '56cfb17f-7b29-4d07-afd8-493c4f43c56a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Delete snapshot completed successfully. Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dff55155-f481-46f2-8ee5-196dc2c00e25 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-104420ba-026f-432b-8dad-4bbd392a35fb-delete_snapshot" released by "delete_snapshot" :: held 1.798s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Lock "cinder-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-quobyte-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[610dff93-34b5-4de4-b285-abed225ac3e6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:34 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e Nov 05 15:05:34 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (457bb2eb-c8ed-4c98-81fb-c4f9ec7df574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2801c6cc-123b-456e-bbc4-9291b867f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2801c6cc-123b-456e-bbc4-9291b867f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1665572655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cc7dc6-febe-4f1d-93b3-c10dabbe3768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:34Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c179f98-a199-4a99-8094-5f25ff48dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c179f98-a199-4a99-8094-5f25ff48dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc82f791-5ef8-4417-9092-beb6ba9938c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc82f791-5ef8-4417-9092-beb6ba9938c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0cc7dc6-febe-4f1d-93b3-c10dabbe3768', 'volume_name': 'volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33199d2-18f0-4f39-9c0c-a3edb53cdf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33199d2-18f0-4f39-9c0c-a3edb53cdf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc69f589-d8db-4f43-a9fb-4f5403926991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Volume c0cc7dc6-febe-4f1d-93b3-c10dabbe3768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768', 'volume_size': 1} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1665572655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0cc7dc6-febe-4f1d-93b3-c10dabbe3768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:34Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Creating volume c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:34 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 1073741824 Nov 05 15:05:34 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:34 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e" returned: 0 in 0.407s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:34 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e Nov 05 15:05:34 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:34 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e" released by "delete_volume" :: held 0.780s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:34 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 1073741824" returned: 0 in 0.522s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Created reservations ['f341a98d-657a-420d-a869-f4895e6cf3a6', 'e77014e8-e893-404b-8918-1549c1f4d2c5', '3237dada-f171-4ad3-9583-2bd9606a9028', 'af00b546-b037-4ded-8c58-cf2005f7317b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:34 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 Nov 05 15:05:34 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:34 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:34 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:35 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Deleted volume successfully. Nov 05 15:05:35 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc69f589-d8db-4f43-a9fb-4f5403926991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a58c5-c831-43dd-9f5a-eb9ff551642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9515e3a1-4049-4be9-955b-b620214d1286 tempest-VolumesActionsTest-886674590 None] Lock "cinder-4be0b7d3-f94d-4ac2-bb3d-b878f07abb8e-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Volume volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 (c0cc7dc6-febe-4f1d-93b3-c10dabbe3768): created successfully Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085a58c5-c831-43dd-9f5a-eb9ff551642a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (457bb2eb-c8ed-4c98-81fb-c4f9ec7df574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3f6e1020-da67-4c25-81f7-ca18b6fa69f5 tempest-VolumesSnapshotTestJSON-1455134048 None] Created volume successfully. Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (b8bf5faa-2ab2-4131-835a-b1ae0ecb89ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0553d539-ac86-4b92-a314-58184a8e4e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0553d539-ac86-4b92-a314-58184a8e4e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-753814080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70487b0e-836f-48f7-aa80-85d8040bf17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:36Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d4690e-bccb-4928-af9d-61be12840596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d4690e-bccb-4928-af9d-61be12840596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ed534-4fb6-43fb-9d43-22681a3b3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42ed534-4fb6-43fb-9d43-22681a3b3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70487b0e-836f-48f7-aa80-85d8040bf17e', 'volume_name': 'volume-70487b0e-836f-48f7-aa80-85d8040bf17e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa92356e-df38-424d-b37c-b7dc7ae2ad4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa92356e-df38-424d-b37c-b7dc7ae2ad4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07587aa6-8c38-40a2-9332-5ccc4ef9eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Volume 70487b0e-836f-48f7-aa80-85d8040bf17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70487b0e-836f-48f7-aa80-85d8040bf17e', 'volume_size': 1} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-753814080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70487b0e-836f-48f7-aa80-85d8040bf17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:36Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Creating volume 70487b0e-836f-48f7-aa80-85d8040bf17e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:35 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e 1073741824 Nov 05 15:05:35 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:36 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e 1073741824" returned: 0 in 0.460s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:36 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e Nov 05 15:05:36 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:36 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.104s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07587aa6-8c38-40a2-9332-5ccc4ef9eb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70487b0e-836f-48f7-aa80-85d8040bf17e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5972335d-b54b-4d52-abb4-989a42ae3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Creating offline snapshot 3296b93a-2879-470b-ae5a-b3b85a763cf6 of volume c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:05:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Volume volume-70487b0e-836f-48f7-aa80-85d8040bf17e (70487b0e-836f-48f7-aa80-85d8040bf17e): created successfully Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5972335d-b54b-4d52-abb4-989a42ae3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (b8bf5faa-2ab2-4131-835a-b1ae0ecb89ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a85438d-8c1d-49fb-803e-616d4f7086ab]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-65ed3792-e69d-482f-b438-aed390c16800 tempest-VolumesActionsTest-1297437581 None] Created volume successfully. Nov 05 15:05:36 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 Nov 05 15:05:36 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:37 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" returned: 0 in 0.419s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:37 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 1G Nov 05 15:05:37 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:37 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 1G" returned: 0 in 0.469s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:37 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 Nov 05 15:05:37 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:37 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 is being set with open permissions: ugo+rw Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:37 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 Nov 05 15:05:37 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-70487b0e-836f-48f7-aa80-85d8040bf17e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Lock "cinder-70487b0e-836f-48f7-aa80-85d8040bf17e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-quobyte-70487b0e-836f-48f7-aa80-85d8040bf17e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-70487b0e-836f-48f7-aa80-85d8040bf17e" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e475c9b3-6cfc-4380-8ea1-94c312c0ce39]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:38 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:38 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e Nov 05 15:05:38 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:38 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info Nov 05 15:05:38 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:38 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:38 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info is being set with open permissions: ugo+rw Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:38 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info Nov 05 15:05:38 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:38 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e" returned: 0 in 0.492s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:38 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e Nov 05 15:05:38 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:38 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.info" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ccd44bee-1d61-4df0-9e5c-5429bea0f6d4 tempest-VolumesSnapshotTestJSON-1455134048 None] Create snapshot completed successfully Nov 05 15:05:38 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-70487b0e-836f-48f7-aa80-85d8040bf17e" returned: 0 in 0.295s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-70487b0e-836f-48f7-aa80-85d8040bf17e" released by "delete_volume" :: held 0.842s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Created reservations ['124fa643-d783-44ef-aa68-0fe9af72d47b', '6f19124c-1e6c-4d63-85d9-b967552ee99d', '24549a83-7881-4e82-9d9f-740cab6e31c7', '8da1b9d6-baf0-4a77-b861-616da30cdb21'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:39 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:39 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:39 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:39 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-498f4a26-811d-466c-80ed-21148c362d47 tempest-GroupSnapshotsV319Test-1042327163 None] Group tempest-GroupSnapshotsV319Test-Group-1935596131: creating Nov 05 15:05:39 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Deleted volume successfully. Nov 05 15:05:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-498f4a26-811d-466c-80ed-21148c362d47 tempest-GroupSnapshotsV319Test-1042327163 None] Group tempest-GroupSnapshotsV319Test-Group-1935596131: created successfully Nov 05 15:05:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-498f4a26-811d-466c-80ed-21148c362d47 tempest-GroupSnapshotsV319Test-1042327163 None] Create group completed successfully. Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7524b22b-2eb8-47f7-a5ca-6ec595d05b8c tempest-VolumesActionsTest-886674590 None] Lock "cinder-70487b0e-836f-48f7-aa80-85d8040bf17e-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:39 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (0cf87261-1abf-494b-bdb0-a3bb643187b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff2943f-d066-4a62-9c5f-92924a945e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff2943f-d066-4a62-9c5f-92924a945e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554490286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5118bb24-fbc6-4bff-a1b2-12a7524f4146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:40Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f9c08d-b622-4c68-9e7d-44f85e1b3c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f9c08d-b622-4c68-9e7d-44f85e1b3c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce341ff-b279-43ad-81ea-11d739a74daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce341ff-b279-43ad-81ea-11d739a74daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5118bb24-fbc6-4bff-a1b2-12a7524f4146', 'volume_name': 'volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91a029e-f76b-47cc-900d-1c70630cae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91a029e-f76b-47cc-900d-1c70630cae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3f299f-a14f-4c50-a337-3813947d00a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Volume 5118bb24-fbc6-4bff-a1b2-12a7524f4146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146', 'volume_size': 1} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554490286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5118bb24-fbc6-4bff-a1b2-12a7524f4146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:40Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Creating volume 5118bb24-fbc6-4bff-a1b2-12a7524f4146 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:39 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 1073741824 Nov 05 15:05:39 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (df622fa5-fd90-438c-b767-68ebeceaf5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69c99c7-aa87-448e-8b05-a48383c179a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69c99c7-aa87-448e-8b05-a48383c179a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-566976037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50e860-38be-4bab-8c69-b851104aff45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3296b93a-2879-470b-ae5a-b3b85a763cf6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:40Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff6be4-f21a-43cc-ad92-6513572d1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aff6be4-f21a-43cc-ad92-6513572d1252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73adfd94-f242-4f1d-9b6c-84e25260742d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73adfd94-f242-4f1d-9b6c-84e25260742d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b50e860-38be-4bab-8c69-b851104aff45', 'volume_name': 'volume-9b50e860-38be-4bab-8c69-b851104aff45', 'volume_size': 2, 'snapshot_id': '3296b93a-2879-470b-ae5a-b3b85a763cf6'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418c9c07-b713-4b57-b7de-a1f5b03766ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418c9c07-b713-4b57-b7de-a1f5b03766ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4777a9f0-8cf9-4ec2-9472-11a010bb23e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Volume 9b50e860-38be-4bab-8c69-b851104aff45: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b50e860-38be-4bab-8c69-b851104aff45', 'volume_size': 2, 'snapshot_id': '3296b93a-2879-470b-ae5a-b3b85a763cf6'} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:40 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 1073741824" returned: 0 in 0.503s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:40 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 Nov 05 15:05:40 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:40 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.361s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-3296b93a-2879-470b-ae5a-b3b85a763cf6-9b50e860-38be-4bab-8c69-b851104aff45" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3f299f-a14f-4c50-a337-3813947d00a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209a9ade-54d1-46a5-aeb0-53c19f8ed8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-3296b93a-2879-470b-ae5a-b3b85a763cf6-9b50e860-38be-4bab-8c69-b851104aff45" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Creating volume 9b50e860-38be-4bab-8c69-b851104aff45 from snapshot 3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-9b50e860-38be-4bab-8c69-b851104aff45" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Volume volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 (5118bb24-fbc6-4bff-a1b2-12a7524f4146): created successfully Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209a9ade-54d1-46a5-aeb0-53c19f8ed8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (0cf87261-1abf-494b-bdb0-a3bb643187b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-9b50e860-38be-4bab-8c69-b851104aff45" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] snapshot: 3296b93a-2879-470b-ae5a-b3b85a763cf6, volume: 9b50e860-38be-4bab-8c69-b851104aff45, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-669dda1b-4ed5-480b-9e01-77fd2e600c8a tempest-VolumesActionsTest-1297437581 None] Created volume successfully. Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc5fd1d-b679-4e11-8ba2-a84d7afb6343]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Flow 'volume_create_manager' (d58b8702-c63a-4a36-8c8e-686f78113e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:41 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 Nov 05 15:05:41 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae95323-fc17-4b18-9e07-c48709e52071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae95323-fc17-4b18-9e07-c48709e52071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1985854626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ff97d22-2767-41f7-b249-be542065e806,host='devstack@QuobyteHD#QuobyteHD',id=7b5d229f-c6b0-4f86-9b89-06fc708b111d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1593399df5e4b98bf45cfede4c718d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:41Z,use_quota=True,user_id='de7849ef9cef4013930b4c061b9f7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7c06e22-2408-47c4-8c1f-1e082d393dd2),volume_type_id=e7c06e22-2408-47c4-8c1f-1e082d393dd2)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aca756-9a5f-4436-bb6a-c723c7e79f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aca756-9a5f-4436-bb6a-c723c7e79f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e69a24-ed23-4e2f-ba59-49ba8f517f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e69a24-ed23-4e2f-ba59-49ba8f517f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5d229f-c6b0-4f86-9b89-06fc708b111d', 'volume_name': 'volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720189f7-762e-4a3e-b129-a4e183bd2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720189f7-762e-4a3e-b129-a4e183bd2b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2149862f-fcab-4a84-b8a0-a91a0cc87467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Volume 7b5d229f-c6b0-4f86-9b89-06fc708b111d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d', 'volume_size': 1} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:41 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c02bd-4ec5-4a8a-97ea-e00352b58e37]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:41 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 Nov 05 15:05:41 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:41 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:05:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:41 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 Nov 05 15:05:41 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-5118bb24-fbc6-4bff-a1b2-12a7524f4146-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Lock "cinder-5118bb24-fbc6-4bff-a1b2-12a7524f4146-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Acquiring lock "cinder-quobyte-5118bb24-fbc6-4bff-a1b2-12a7524f4146" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-5118bb24-fbc6-4bff-a1b2-12a7524f4146" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43ecd5c-65b4-4d92-ac0d-6d6a2ec2a285]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:42 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 Nov 05 15:05:42 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:42 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146" returned: 0 in 0.617s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:42 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146 Nov 05 15:05:42 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:43 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5118bb24-fbc6-4bff-a1b2-12a7524f4146" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Lock "cinder-quobyte-5118bb24-fbc6-4bff-a1b2-12a7524f4146" released by "delete_volume" :: held 1.026s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Created reservations ['1590ef79-03fd-4514-a168-358dd19a061e', 'da5911a1-e9d4-4116-b0e9-de4cbc4fefed', 'f038185a-fe1d-4635-a112-f5fd17541ac0', '3bba1f9a-d092-46f3-af1f-6b7567902841'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:43 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:43 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:44 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.581s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Deleted volume successfully. Nov 05 15:05:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f521c98-7274-4e5e-9421-e675c68b7843 tempest-VolumesActionsTest-886674590 None] Lock "cinder-5118bb24-fbc6-4bff-a1b2-12a7524f4146-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (5fae7b38-856b-415e-b999-fad05e16f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b0261f-82a3-487b-860e-cc370200be78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b0261f-82a3-487b-860e-cc370200be78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819254263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33f5fbf-6d4b-4899-91fe-7137dbda07e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:45Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec20b9b-0e59-48c8-8998-c8f24ff2a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec20b9b-0e59-48c8-8998-c8f24ff2a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bcbe9b-7d0c-49e7-853d-e07d692e423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bcbe9b-7d0c-49e7-853d-e07d692e423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33f5fbf-6d4b-4899-91fe-7137dbda07e9', 'volume_name': 'volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476b7c76-4870-4cdf-b574-8e0511c3dc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476b7c76-4870-4cdf-b574-8e0511c3dc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dc3b97-97c0-49e6-bdce-a3a1d35d561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Volume e33f5fbf-6d4b-4899-91fe-7137dbda07e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9', 'volume_size': 1} Nov 05 15:05:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:48 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45" returned: 0 in 6.748s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:05:48 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Converted 1024.00 MB image at 151.72 MB/s Nov 05 15:05:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 is being set with open permissions: ugo+rw Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:48 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 Nov 05 15:05:48 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:48 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-9b50e860-38be-4bab-8c69-b851104aff45" released by "_copy_volume_from_snapshot" :: held 7.843s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-3296b93a-2879-470b-ae5a-b3b85a763cf6-9b50e860-38be-4bab-8c69-b851104aff45" released by "_create_volume_from_snapshot" :: held 7.944s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.991s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.627s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ff97d22-2767-41f7-b249-be542065e806,created_at=2026-11-05T14:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1985854626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ff97d22-2767-41f7-b249-be542065e806,host='devstack@QuobyteHD#QuobyteHD',id=7b5d229f-c6b0-4f86-9b89-06fc708b111d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1593399df5e4b98bf45cfede4c718d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:41Z,use_quota=True,user_id='de7849ef9cef4013930b4c061b9f7cd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7c06e22-2408-47c4-8c1f-1e082d393dd2),volume_type_id=e7c06e22-2408-47c4-8c1f-1e082d393dd2)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Creating volume 7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:48 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:48 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d 1073741824 Nov 05 15:05:48 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4777a9f0-8cf9-4ec2-9472-11a010bb23e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b50e860-38be-4bab-8c69-b851104aff45', 'volume_size': 2, 'snapshot_id': '3296b93a-2879-470b-ae5a-b3b85a763cf6'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af2237f-3c9f-49d9-9578-e34cca3a3575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Volume volume-9b50e860-38be-4bab-8c69-b851104aff45 (9b50e860-38be-4bab-8c69-b851104aff45): created successfully Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af2237f-3c9f-49d9-9578-e34cca3a3575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (df622fa5-fd90-438c-b767-68ebeceaf5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cdd3eb14-72fa-4399-920a-7a728751386a tempest-VolumesSnapshotTestJSON-1455134048 None] Created volume successfully. Nov 05 15:05:49 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d 1073741824" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:49 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d Nov 05 15:05:49 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:49 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1819254263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33f5fbf-6d4b-4899-91fe-7137dbda07e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebad0deb7ef41c6afd4e8c3a46a6949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:45Z,use_quota=True,user_id='56db43132f2947f184065f7034f98622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Creating volume e33f5fbf-6d4b-4899-91fe-7137dbda07e9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:49 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2149862f-fcab-4a84-b8a0-a91a0cc87467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:49 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 1073741824 Nov 05 15:05:49 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed70efc-ce1c-4e33-99c7-d12125e4f206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Volume volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d (7b5d229f-c6b0-4f86-9b89-06fc708b111d): created successfully Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed70efc-ce1c-4e33-99c7-d12125e4f206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Flow 'volume_create_manager' (d58b8702-c63a-4a36-8c8e-686f78113e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-40e4e9d9-5c60-4be9-821a-0f110f69ee38 tempest-GroupSnapshotsV319Test-1042327163 None] Created volume successfully. Nov 05 15:05:49 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 1073741824" returned: 0 in 0.426s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:49 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 Nov 05 15:05:49 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-9b50e860-38be-4bab-8c69-b851104aff45-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-9b50e860-38be-4bab-8c69-b851104aff45-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-9b50e860-38be-4bab-8c69-b851104aff45" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-9b50e860-38be-4bab-8c69-b851104aff45" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60affe3-2b4c-412f-ad51-fcb8f20f1f97]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:50 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dc3b97-97c0-49e6-bdce-a3a1d35d561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f251590-2f7d-4cf3-903a-6c78f10697ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Volume volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 (e33f5fbf-6d4b-4899-91fe-7137dbda07e9): created successfully Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f251590-2f7d-4cf3-903a-6c78f10697ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Flow 'volume_create_manager' (5fae7b38-856b-415e-b999-fad05e16f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:50 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 Nov 05 15:05:50 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3ed49493-e200-4d48-8091-ea3fc226f91e tempest-VolumesActionsTest-1297437581 None] Created volume successfully. Nov 05 15:05:50 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:50 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45 Nov 05 15:05:50 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:50 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9b50e860-38be-4bab-8c69-b851104aff45" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-9b50e860-38be-4bab-8c69-b851104aff45" released by "delete_volume" :: held 0.687s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['022986b8-b8dd-416a-865d-6ff2f374fbce', 'cd5485b9-4add-4c45-8d6e-c84f4c8fc203', '2e4a1669-337e-46f9-aef8-cd3f3c923e8e', '9a725832-7b42-42a1-8fe6-2332c5e20669'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:50 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:50 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] GroupSnapshot 301b0361-eb40-4ac7-8a65-e3bada2adfcc: creating. Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Group snapshot 301b0361-eb40-4ac7-8a65-e3bada2adfcc: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Creating offline snapshot a6f35b02-c807-4f25-ab92-5461bb8f8fb1 of volume 7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[db68f360-72e4-41ad-91c6-7d35373aa017]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:51 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "cinder-e33f5fbf-6d4b-4899-91fe-7137dbda07e9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-3296b93a-2879-470b-ae5a-b3b85a763cf6-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Deleted volume successfully. Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-e33f5fbf-6d4b-4899-91fe-7137dbda07e9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-3296b93a-2879-470b-ae5a-b3b85a763cf6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5037016a-d296-4925-ad25-fd0402406da8 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-9b50e860-38be-4bab-8c69-b851104aff45-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-3296b93a-2879-470b-ae5a-b3b85a763cf6" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "cinder-quobyte-e33f5fbf-6d4b-4899-91fe-7137dbda07e9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-3296b93a-2879-470b-ae5a-b3b85a763cf6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Deleting offline snapshot 3296b93a-2879-470b-ae5a-b3b85a763cf6 of volume c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:05:51 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d Nov 05 15:05:51 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] snapshot_file for this snap is: volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-quobyte-e33f5fbf-6d4b-4899-91fe-7137dbda07e9" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac40e7-5845-4134-bb04-92093320e550]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed29eb2-0cf1-457b-adb1-35fdbc17ae34]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:51 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 Nov 05 15:05:51 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:51 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 Nov 05 15:05:51 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:51 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d" returned: 0 in 0.430s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:51 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 1G Nov 05 15:05:51 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:51 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:05:51 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9" returned: 0 in 0.430s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1634fc7-610f-4100-921f-6489b3d55a8a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:51 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9 Nov 05 15:05:51 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:51 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 Nov 05 15:05:52 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:52 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 1G" returned: 0 in 0.486s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:52 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 Nov 05 15:05:52 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:52 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e33f5fbf-6d4b-4899-91fe-7137dbda07e9" returned: 0 in 0.311s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-quobyte-e33f5fbf-6d4b-4899-91fe-7137dbda07e9" released by "delete_volume" :: held 0.799s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Created reservations ['2e9b7bdc-d0bb-4f6c-9199-58b589f1ef9f', '02dda99a-0caf-4929-9e72-7944a2c5d679', 'b97f3be8-a382-4cea-9298-dff642c84993', '25b6c386-f195-44a9-a006-fc7b27fa6b37'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:52 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:52 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:52 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:52 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:52 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" returned: 0 in 0.717s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:52 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 Nov 05 15:05:52 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:52 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 Nov 05 15:05:52 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:52 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Deleted volume successfully. Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5d861c02-76ee-48a9-853a-8d5caf82f063 tempest-VolumesActionsTest-1297437581 None] Lock "cinder-e33f5fbf-6d4b-4899-91fe-7137dbda07e9-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:52 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:52 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info Nov 05 15:05:52 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:53 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6" returned: 0 in 0.567s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:53 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6 Nov 05 15:05:53 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:53 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:53 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:53 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info Nov 05 15:05:53 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:53 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768.3296b93a-2879-470b-ae5a-b3b85a763cf6" returned: 0 in 0.419s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-3296b93a-2879-470b-ae5a-b3b85a763cf6" released by "_delete_snapshot" :: held 2.293s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" released by "delete_snapshot" :: held 2.331s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['cd68e674-9d9e-472a-8e93-9a802b9ccda5', 'ad9d9849-5690-4c90-b230-f4326b4ee9e4', '875fbef8-661e-4e2f-bb9e-7d9aabb732a6', '02ede3ef-e251-4538-8be1-909685b847fd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Delete snapshot completed successfully. Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82019a1a-7453-4440-8465-8d339578168c tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-3296b93a-2879-470b-ae5a-b3b85a763cf6-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:53 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.info" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.694s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-60954f90-a17b-4886-95cd-87f2b7a35a7d tempest-GroupSnapshotsV319Test-1042327163 None] group_snapshot 301b0361-eb40-4ac7-8a65-e3bada2adfcc: created successfully Nov 05 15:05:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-801466f3-cdfa-45fe-a3a9-2ebbf9e2784f tempest-ServerActionsTestOtherA-98116980 None] Terminate volume connection completed successfully. Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-801466f3-cdfa-45fe-a3a9-2ebbf9e2784f tempest-ServerActionsTestOtherA-98116980 None] Deleting attachment 7a74b754-d03a-4bd5-acdd-c51ed1ec2f5b. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "cinder-b20b0e72-a832-4c03-82eb-64810d5d4ce6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-b20b0e72-a832-4c03-82eb-64810d5d4ce6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "cinder-quobyte-b20b0e72-a832-4c03-82eb-64810d5d4ce6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-quobyte-b20b0e72-a832-4c03-82eb-64810d5d4ce6" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16b7a67-565a-4e80-80d8-5d8faf9f2ac8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:54 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 Nov 05 15:05:54 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c6f085-911d-48fb-a0b9-fd54c0be272f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:55 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 Nov 05 15:05:55 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] group_snapshot 301b0361-eb40-4ac7-8a65-e3bada2adfcc: deleting Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] group_snapshot 301b0361-eb40-4ac7-8a65-e3bada2adfcc: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "cinder-quobyte-7b5d229f-c6b0-4f86-9b89-06fc708b111d" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "cinder-quobyte-7b5d229f-c6b0-4f86-9b89-06fc708b111d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "cinder-quobyte-a6f35b02-c807-4f25-ab92-5461bb8f8fb1" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "cinder-quobyte-a6f35b02-c807-4f25-ab92-5461bb8f8fb1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Deleting offline snapshot a6f35b02-c807-4f25-ab92-5461bb8f8fb1 of volume 7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:05:55 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] snapshot_file for this snap is: volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6" returned: 0 in 0.684s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f69ec-f38b-4890-b18c-94c454dbb516]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:55 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6 Nov 05 15:05:55 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:55 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" returned: 0 in 0.631s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:55 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768 Nov 05 15:05:55 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:55 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 Nov 05 15:05:55 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:55 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b20b0e72-a832-4c03-82eb-64810d5d4ce6" returned: 0 in 0.400s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-quobyte-b20b0e72-a832-4c03-82eb-64810d5d4ce6" released by "delete_volume" :: held 1.180s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:55 devstack cinder-volume[87126]: DEBUG cinder.quota [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Created reservations ['35d5e37f-b939-47cd-8203-f3f623c15c22', '6c7f956e-0c0d-4598-82cb-08339cb34f32', '81d6057e-9574-4a95-b473-048cb22dc07f', 'fe58fe97-6c93-4502-b2c0-860e49012456'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:56 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" returned: 0 in 0.398s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768" released by "delete_volume" :: held 1.140s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:56 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:56 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:56 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1" returned: 0 in 0.649s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfee089-4e2c-4f9e-b95b-8a3df67fe39c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['727038a3-197c-4548-8b98-26397f7de92c', '876ceabd-7589-4cbd-bb1a-7172bc1429e2', '33a15f54-6197-4d19-b595-88eeb4aca524', '6a1ab916-0fe1-457b-b4c3-a77561f1b4df'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:56 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:56 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:56 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d Nov 05 15:05:56 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:56 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.manager [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Deleted volume successfully. Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-e9f46e11-e867-4d5c-9a79-322749f00af0 req-18e2301b-8bb4-48f3-826e-ee21c6ee35ea tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-b20b0e72-a832-4c03-82eb-64810d5d4ce6-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:56 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Deleted volume successfully. Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-571d3bb9-a56c-45e6-ae80-d3242238336a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-c0cc7dc6-febe-4f1d-93b3-c10dabbe3768-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:56 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:56 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 Nov 05 15:05:56 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "cinder-04664867-debd-4d3c-9c79-607ab079d4ea-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:57 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1" returned: 0 in 0.398s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-04664867-debd-4d3c-9c79-607ab079d4ea-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:57 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1 Nov 05 15:05:57 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "cinder-quobyte-04664867-debd-4d3c-9c79-607ab079d4ea" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-quobyte-04664867-debd-4d3c-9c79-607ab079d4ea" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac2115d-a38f-447e-bf72-9ff3b0597ecf]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:57 devstack sudo[93692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea Nov 05 15:05:57 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:57 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d.a6f35b02-c807-4f25-ab92-5461bb8f8fb1" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "cinder-quobyte-a6f35b02-c807-4f25-ab92-5461bb8f8fb1" released by "_delete_snapshot" :: held 2.038s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Lock "cinder-quobyte-7b5d229f-c6b0-4f86-9b89-06fc708b111d" released by "delete_snapshot" :: held 2.078s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:57 devstack cinder-volume[87126]: WARNING cinder.quota [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1258851159 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1258851159, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:05:57 devstack cinder-volume[87126]: WARNING cinder.quota [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1258851159 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1258851159, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] Created reservations ['f998024b-36b8-4254-b2a9-b47e7dae45f8', 'cdf034fb-4f93-4979-8a91-24320744c11b', 'e3736a75-9d05-4cab-84bf-f56e4594b765', 'cb2cd5d1-56c7-45f3-a150-bd239f0f0cc0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8b76e103-eb3a-45eb-8ac2-a7c5a6ea9ec6 tempest-GroupSnapshotsV319Test-1042327163 None] group_snapshot 301b0361-eb40-4ac7-8a65-e3bada2adfcc: deleted successfully Nov 05 15:05:57 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea" returned: 0 in 0.493s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:57 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea Nov 05 15:05:57 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (e624ff03-975b-4793-ab0f-c7eed9da395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb2a765-6ce4-4ca6-9a5c-a904b400843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb2a765-6ce4-4ca6-9a5c-a904b400843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2069891870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f6d94a-48cb-4449-8397-be2a7fdc7189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:58Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9d52e6-5480-4e20-be7f-49982c09323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9d52e6-5480-4e20-be7f-49982c09323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae364e4-32a4-42db-a10d-5029c9e710e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae364e4-32a4-42db-a10d-5029c9e710e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f6d94a-48cb-4449-8397-be2a7fdc7189', 'volume_name': 'volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18e7490-c35a-4dfb-9291-72536c065d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18e7490-c35a-4dfb-9291-72536c065d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3a1255-969f-4049-87d2-70668e122d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Volume e8f6d94a-48cb-4449-8397-be2a7fdc7189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189', 'volume_size': 1} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2069891870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f6d94a-48cb-4449-8397-be2a7fdc7189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:05:58Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Creating volume e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:05:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:57 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 1073741824 Nov 05 15:05:57 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:57 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-04664867-debd-4d3c-9c79-607ab079d4ea" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-quobyte-04664867-debd-4d3c-9c79-607ab079d4ea" released by "delete_volume" :: held 0.834s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "cinder-quobyte-7b5d229f-c6b0-4f86-9b89-06fc708b111d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Created reservations ['89a489e4-1f7d-402e-aaa3-46482c60fb85', '1e049611-a219-46ae-98dc-0a6ab92afeb9', '6e2a05e9-0dda-4b05-9bfa-d8edab2586b3', '100a3589-e6f3-4937-97fd-3445c1f4735d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Lock "cinder-quobyte-7b5d229f-c6b0-4f86-9b89-06fc708b111d" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec597ee-c630-4b97-8b60-8621cb98d631]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:58 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:58 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:58 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d Nov 05 15:05:58 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:58 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 1073741824" returned: 0 in 0.664s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:58 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:58 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 Nov 05 15:05:58 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Deleted volume successfully. Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9e7ae81c-7a26-4773-aef4-f3a8b3580446 tempest-ServerActionsTestOtherA-98116980 None] Lock "cinder-04664867-debd-4d3c-9c79-607ab079d4ea-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:58 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d" returned: 0 in 0.608s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:58 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d Nov 05 15:05:58 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:58 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3a1255-969f-4049-87d2-70668e122d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c5c32-2f38-4be1-8dc9-1c33124907b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:05:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Volume volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 (e8f6d94a-48cb-4449-8397-be2a7fdc7189): created successfully Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258c5c32-2f38-4be1-8dc9-1c33124907b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:05:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (e624ff03-975b-4793-ab0f-c7eed9da395b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:05:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8ac15423-2301-4bdb-96fe-1c5d1f2d1ace tempest-VolumesSnapshotTestJSON-1455134048 None] Created volume successfully. Nov 05 15:05:59 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b5d229f-c6b0-4f86-9b89-06fc708b111d" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Lock "cinder-quobyte-7b5d229f-c6b0-4f86-9b89-06fc708b111d" released by "delete_volume" :: held 0.991s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Created reservations ['d7873e26-3229-4b0c-9243-6af3424e640c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:59 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1258851159 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1258851159, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Created reservations ['9c65b7e7-592c-4d32-afc1-62c134587de7', 'b216551c-6c2a-42a8-8b80-d2621f189ac8', 'fe274600-2069-4101-bbcc-ef1b5682b582', '7bbc7d58-0a37-4264-af5f-769e1ddbbbaa'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:05:59 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:05:59 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:05:59 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:05:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:05:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2bd3e16d-8c54-4dba-b1b0-cfa0f92b5e3c tempest-GroupSnapshotsV319Test-1042327163 None] Delete group completed successfully. Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Creating offline snapshot cf1f3af8-a369-445f-b714-9fdb15f83304 of volume e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6191a5a-b536-4044-95f7-5e9f2ff298fd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:00 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 Nov 05 15:06:00 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:00 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:00 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 1G Nov 05 15:06:00 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:01 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 1G" returned: 0 in 0.587s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:01 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 Nov 05 15:06:01 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:01 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304" returned: 0 in 0.403s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:01 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 is being set with open permissions: ugo+rw Nov 05 15:06:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:01 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 Nov 05 15:06:01 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:02 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:02 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info Nov 05 15:06:02 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:02 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info" returned: 0 in 0.286s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:02 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info is being set with open permissions: ugo+rw Nov 05 15:06:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:02 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info Nov 05 15:06:02 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:02 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.info" returned: 0 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f6e25866-b576-4f47-aee8-982c652cddbb tempest-VolumesSnapshotTestJSON-1455134048 None] Create snapshot completed successfully Nov 05 15:06:03 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (fd229025-fe08-4e16-a588-bd146858ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3f0f46-8d65-43ea-b725-1b49155f1211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3f0f46-8d65-43ea-b725-1b49155f1211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-917962395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1d8027-5345-4f27-975d-4004fde3d6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='730a93dfac9646109b9198528c761dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf1f3af8-a369-445f-b714-9fdb15f83304,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:04Z,use_quota=True,user_id='1b8142f259734414880a1f852f255878',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7684b6dc-6c7c-4492-972e-c14a2ea6e9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7684b6dc-6c7c-4492-972e-c14a2ea6e9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9ad3b6-393d-4e86-ad41-d7536839203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9ad3b6-393d-4e86-ad41-d7536839203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa1d8027-5345-4f27-975d-4004fde3d6ad', 'volume_name': 'volume-aa1d8027-5345-4f27-975d-4004fde3d6ad', 'volume_size': 1, 'snapshot_id': 'cf1f3af8-a369-445f-b714-9fdb15f83304'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2844e1-0668-4fd8-a1c0-4a371a700842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2844e1-0668-4fd8-a1c0-4a371a700842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d902eb6b-68d8-4db6-9c61-b1f68b6a56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Volume aa1d8027-5345-4f27-975d-4004fde3d6ad: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa1d8027-5345-4f27-975d-4004fde3d6ad', 'volume_size': 1, 'snapshot_id': 'cf1f3af8-a369-445f-b714-9fdb15f83304'} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-cf1f3af8-a369-445f-b714-9fdb15f83304-aa1d8027-5345-4f27-975d-4004fde3d6ad" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-cf1f3af8-a369-445f-b714-9fdb15f83304-aa1d8027-5345-4f27-975d-4004fde3d6ad" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Creating volume aa1d8027-5345-4f27-975d-4004fde3d6ad from snapshot cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-aa1d8027-5345-4f27-975d-4004fde3d6ad" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-aa1d8027-5345-4f27-975d-4004fde3d6ad" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] snapshot: cf1f3af8-a369-445f-b714-9fdb15f83304, volume: aa1d8027-5345-4f27-975d-4004fde3d6ad, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d852dfe1-f1af-41ef-b1e6-dcb45e2b6119]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:04 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 Nov 05 15:06:04 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:04 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304" returned: 0 in 0.485s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4a7493-4345-4bf2-9797-176075af5ba1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:04 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 Nov 05 15:06:04 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:05 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189" returned: 0 in 0.462s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:06:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:06:05 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:06:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:05 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad Nov 05 15:06:05 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=120,cinder:INSERT=38,cinder:UPDATE=160,cinder:DELETE=12 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=135,cinder:UPDATE=148,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:06:14 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad" returned: 0 in 9.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:06:14 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Converted 1024.00 MB image at 109.76 MB/s Nov 05 15:06:14 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad is being set with open permissions: ugo+rw Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:14 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad Nov 05 15:06:14 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:14 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-aa1d8027-5345-4f27-975d-4004fde3d6ad" released by "_copy_volume_from_snapshot" :: held 10.722s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-cf1f3af8-a369-445f-b714-9fdb15f83304-aa1d8027-5345-4f27-975d-4004fde3d6ad" released by "_create_volume_from_snapshot" :: held 10.839s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.858s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d902eb6b-68d8-4db6-9c61-b1f68b6a56e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1d8027-5345-4f27-975d-4004fde3d6ad', 'volume_size': 1, 'snapshot_id': 'cf1f3af8-a369-445f-b714-9fdb15f83304'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f8b53e-c2f4-4668-9286-d303c6cd6df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Volume volume-aa1d8027-5345-4f27-975d-4004fde3d6ad (aa1d8027-5345-4f27-975d-4004fde3d6ad): created successfully Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f8b53e-c2f4-4668-9286-d303c6cd6df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Flow 'volume_create_manager' (fd229025-fe08-4e16-a588-bd146858ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-030528fd-cb09-4643-9402-a3d1966840a0 tempest-VolumesSnapshotTestJSON-1455134048 None] Created volume successfully. Nov 05 15:06:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-aa1d8027-5345-4f27-975d-4004fde3d6ad-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-aa1d8027-5345-4f27-975d-4004fde3d6ad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-aa1d8027-5345-4f27-975d-4004fde3d6ad" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-aa1d8027-5345-4f27-975d-4004fde3d6ad" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0b4944-bd86-4451-8267-421a7fa2d920]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:15 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad Nov 05 15:06:15 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:16 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad" returned: 0 in 0.441s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:16 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad Nov 05 15:06:16 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:16 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-aa1d8027-5345-4f27-975d-4004fde3d6ad" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-aa1d8027-5345-4f27-975d-4004fde3d6ad" released by "delete_volume" :: held 0.874s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['9bf25a00-d86b-45da-80bc-835020620309', '665b2c49-0d29-4bf3-afcd-033cee0968d8', '6ad34fca-5e83-45d6-abba-cbfaa471feab', '1d231bf2-93a8-4fd5-bd45-ed04ecd5f84e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:16 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:16 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-cf1f3af8-a369-445f-b714-9fdb15f83304-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-cf1f3af8-a369-445f-b714-9fdb15f83304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-e8f6d94a-48cb-4449-8397-be2a7fdc7189" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-e8f6d94a-48cb-4449-8397-be2a7fdc7189" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-cf1f3af8-a369-445f-b714-9fdb15f83304" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-cf1f3af8-a369-445f-b714-9fdb15f83304" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Deleting offline snapshot cf1f3af8-a369-445f-b714-9fdb15f83304 of volume e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] snapshot_file for this snap is: volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[83094ba7-832c-432c-aeea-94f23b74946f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:16 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Deleted volume successfully. Nov 05 15:06:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ea72f5a-3b04-42ad-9b6a-bb20790d9a2a tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-aa1d8027-5345-4f27-975d-4004fde3d6ad-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:17 devstack sudo[93827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 Nov 05 15:06:17 devstack sudo[93827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:17 devstack sudo[93827]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a012f825-bf43-4abd-837a-395f7e60d868]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:17 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 Nov 05 15:06:17 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:18 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189" returned: 0 in 0.783s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:18 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 Nov 05 15:06:18 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:18 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304" returned: 0 in 0.538s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:18 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304 Nov 05 15:06:18 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:18 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189.cf1f3af8-a369-445f-b714-9fdb15f83304" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-cf1f3af8-a369-445f-b714-9fdb15f83304" released by "_delete_snapshot" :: held 2.209s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-e8f6d94a-48cb-4449-8397-be2a7fdc7189" released by "delete_snapshot" :: held 2.245s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['1ec88568-00a4-4cc9-98ea-a2f6ccc27dfd', 'a8e8b839-9000-4f48-9e4f-971944b0ba71', '05813c75-17b9-4252-ae67-36a21fed28cd', 'deae364a-69d6-450c-9283-16e0ca05a6df'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Delete snapshot completed successfully. Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-874383bb-8755-450a-8996-ea8402f65e07 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-cf1f3af8-a369-445f-b714-9fdb15f83304-delete_snapshot" released by "delete_snapshot" :: held 2.484s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Flow 'volume_create_manager' (b4482fac-98b5-4bff-b4fa-32bdc29571c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57225abe-cc8e-48d9-b00c-188ee5596c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57225abe-cc8e-48d9-b00c-188ee5596c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-521808615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f3a6cd-4b93-45fd-9cf4-66812c9c58c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f57a7271243fab3ad8d5ac0084408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:19Z,use_quota=True,user_id='a65391650d65465dba3ef0b4c753a4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966cd032-6b98-4d43-8a17-f4990aa9ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966cd032-6b98-4d43-8a17-f4990aa9ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75376df-2ec9-448c-990f-7e2516442520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75376df-2ec9-448c-990f-7e2516442520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f3a6cd-4b93-45fd-9cf4-66812c9c58c1', 'volume_name': 'volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc425a1-464d-44f1-925e-6a265285ac41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fc425a1-464d-44f1-925e-6a265285ac41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2db791-0fdf-4962-8aa9-f90b4d5d0ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Volume 47f3a6cd-4b93-45fd-9cf4-66812c9c58c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1', 'volume_size': 1} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-521808615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f3a6cd-4b93-45fd-9cf4-66812c9c58c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f57a7271243fab3ad8d5ac0084408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:19Z,use_quota=True,user_id='a65391650d65465dba3ef0b4c753a4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Creating volume 47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:06:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:19 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 1073741824 Nov 05 15:06:19 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:19 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 1073741824" returned: 0 in 0.525s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:20 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:20 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-e8f6d94a-48cb-4449-8397-be2a7fdc7189-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-e8f6d94a-48cb-4449-8397-be2a7fdc7189-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-e8f6d94a-48cb-4449-8397-be2a7fdc7189" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-e8f6d94a-48cb-4449-8397-be2a7fdc7189" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:20 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2db791-0fdf-4962-8aa9-f90b4d5d0ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0026727b-d936-49a3-bd63-28d88d03aff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ae0df-8f5d-4d7d-9ac9-64cdd84ef37f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Volume volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 (47f3a6cd-4b93-45fd-9cf4-66812c9c58c1): created successfully Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0026727b-d936-49a3-bd63-28d88d03aff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Flow 'volume_create_manager' (b4482fac-98b5-4bff-b4fa-32bdc29571c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1ef5ed92-f92d-46f8-ad6d-8b74edb1272f tempest-VolumesDeleteCascade-1470222884 None] Created volume successfully. Nov 05 15:06:20 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 Nov 05 15:06:20 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:20 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189" returned: 0 in 0.441s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:20 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189 Nov 05 15:06:20 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:21 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8f6d94a-48cb-4449-8397-be2a7fdc7189" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-e8f6d94a-48cb-4449-8397-be2a7fdc7189" released by "delete_volume" :: held 0.809s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['884b5ec8-978a-4e03-a898-6c86a8a8b701', '26e58b71-e1c7-458b-94d6-a4e52c87f5a7', '596e41ea-6e76-4f96-8e3a-7f480f844f97', 'e99963c8-59c1-45bd-b846-6467e093d070'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Flow 'volume_create_manager' (51441961-87cc-465f-b43e-cb913f31c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5906e7-8361-478e-bf34-a0fc8c4319be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5906e7-8361-478e-bf34-a0fc8c4319be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-365477071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4beaae2c-8d10-4bb7-8775-9b6856ffbc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87800f0e05d74e8a931e62e7122b4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:21Z,use_quota=True,user_id='d08ed8f19b6047d9837971af86fcf14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d92b349-e638-4ced-b5f7-06374d3a81b7),volume_type_id=1d92b349-e638-4ced-b5f7-06374d3a81b7)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cede20dc-8816-4f6b-b0c3-f17116ea6dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cede20dc-8816-4f6b-b0c3-f17116ea6dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafa26eb-4ff5-4d1e-aa7a-9e36d762066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafa26eb-4ff5-4d1e-aa7a-9e36d762066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4beaae2c-8d10-4bb7-8775-9b6856ffbc3a', 'volume_name': 'volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76bf2cc-cba7-4920-8e2c-b18edd76a122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76bf2cc-cba7-4920-8e2c-b18edd76a122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5d69d7-21f5-4ffe-be1c-b15ab7d86270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Volume 4beaae2c-8d10-4bb7-8775-9b6856ffbc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a', 'volume_size': 1} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-365477071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4beaae2c-8d10-4bb7-8775-9b6856ffbc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87800f0e05d74e8a931e62e7122b4221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:21Z,use_quota=True,user_id='d08ed8f19b6047d9837971af86fcf14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d92b349-e638-4ced-b5f7-06374d3a81b7),volume_type_id=1d92b349-e638-4ced-b5f7-06374d3a81b7)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Creating volume 4beaae2c-8d10-4bb7-8775-9b6856ffbc3a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:06:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:21 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a 1073741824 Nov 05 15:06:21 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:21 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:21 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "cinder-quobyte-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2232b3d9-9295-494a-85f3-22365cd42d8e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:21 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 Nov 05 15:06:21 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:21 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Deleted volume successfully. Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-28e8b28d-f98a-4bec-b35e-beffe8e29074 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-e8f6d94a-48cb-4449-8397-be2a7fdc7189-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:22 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a 1073741824" returned: 0 in 0.651s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:22 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a Nov 05 15:06:22 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:22 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" returned: 0 in 0.503s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:22 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5 Nov 05 15:06:22 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:22 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.443s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb5d69d7-21f5-4ffe-be1c-b15ab7d86270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05af0d7b-ee0f-48fb-87fb-60b9d6a26998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Creating offline snapshot 666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e of volume 47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:06:22 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae025be3-c978-49bc-a11f-1d2d578593d6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Volume volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a (4beaae2c-8d10-4bb7-8775-9b6856ffbc3a): created successfully Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05af0d7b-ee0f-48fb-87fb-60b9d6a26998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Flow 'volume_create_manager' (51441961-87cc-465f-b43e-cb913f31c323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-quobyte-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5" released by "delete_volume" :: held 0.959s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c597365f-6aed-45a3-add1-7958700f9f8c tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Created volume successfully. Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Created reservations ['d9a87069-2786-4a20-b2bd-3ae6297ebabf', 'a2f32f57-884f-4225-a839-37c42c37e0dc', '94bdc16b-aafd-414a-b391-98d9a820d8d8', '139461d7-f47b-439d-a144-f35a1f8e394c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:22 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:22 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:22 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:22 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:23 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.619s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:23 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Deleted volume successfully. Nov 05 15:06:23 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e 1G Nov 05 15:06:23 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-df10967e-3e69-4f0c-953b-493cdcca6173 tempest-VolumesSnapshotTestJSON-1455134048 None] Lock "cinder-571fbc18-a8d3-41b4-b4c0-a1c0f7c653f5-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:23 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e 1G" returned: 0 in 0.577s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:23 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:23 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:23 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:23 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:24 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.436s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e is being set with open permissions: ugo+rw Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:24 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:24 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:24 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-76e4b198-e1e5-4027-ab5f-f83e68f15679 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Retype volume completed successfully. Nov 05 15:06:24 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:24 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info Nov 05 15:06:24 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:24 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info is being set with open permissions: ugo+rw Nov 05 15:06:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:24 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info Nov 05 15:06:24 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Acquiring lock "cinder-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "cinder-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:25 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.info" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Acquiring lock "cinder-quobyte-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "cinder-quobyte-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7b938fa8-009d-4515-bc14-1e0505ce866a tempest-VolumesDeleteCascade-1470222884 None] Create snapshot completed successfully Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[098a6656-612f-4c02-b59a-5e52a6d3c3b2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:25 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a Nov 05 15:06:25 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:25 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:25 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a Nov 05 15:06:25 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:26 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a" returned: 0 in 0.281s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "cinder-quobyte-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a" released by "delete_volume" :: held 0.823s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:26 devstack cinder-volume[87126]: WARNING cinder.quota [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:06:26 devstack cinder-volume[87126]: WARNING cinder.quota [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Created reservations ['228c01b7-17fe-4159-8bf5-2599b2b2f292', '92db49dc-d1d1-42f9-a468-29c6616204e5', '33c53bca-8a0b-4d14-abab-c13eb2281e0f', '1cf70a63-ad42-4a0e-9811-a2033bd61448'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:26 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:26 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Creating offline snapshot dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa of volume 47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:06:26 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.444s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Deleted volume successfully. Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6812ffdd-bae5-482b-af67-e624163d002f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b7d2b02-ef31-4e58-8e4e-8708d5afe8c0 tempest-VolumeRetypeWithoutMigrationTest-672183119 None] Lock "cinder-4beaae2c-8d10-4bb7-8775-9b6856ffbc3a-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:26 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:26 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:27 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.464s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:27 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa 1G Nov 05 15:06:27 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:27 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa 1G" returned: 0 in 0.683s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:27 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa Nov 05 15:06:27 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:28 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:28 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa is being set with open permissions: ugo+rw Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:28 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa Nov 05 15:06:28 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:28 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.042s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ce756020-e586-40ad-b76d-f8d89ab0b518 tempest-VolumesDeleteCascade-1470222884 None] Create snapshot completed successfully Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Performing cascade delete. {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Deleting offline snapshot 666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e of volume 47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] snapshot_file for this snap is: volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3390e7f-6f2a-471c-9946-49362b9ed0eb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:29 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:29 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:29 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e8849-fc9d-4d6e-80c1-5622f732785c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:29 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:29 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:30 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.602s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8635f2a-6227-41f1-b2df-10e7d75b40b1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:30 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa Nov 05 15:06:30 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:30 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" returned: 0 in 0.509s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a47781c-9641-419c-ba9c-36b26c6d8913]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:31 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:31 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:31 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.568s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c048c44-937c-443d-8422-895c2037932b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:31 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:31 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:31 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.438s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:31 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:31 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:32 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.523s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:32 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e Nov 05 15:06:32 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:32 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa -F qcow2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:32 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa -F qcow2 Nov 05 15:06:32 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:33 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa -F qcow2" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e" released by "_delete_snapshot" :: held 4.172s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" released by "delete_snapshot" :: held 4.201s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Created reservations ['c97c4b85-a8eb-42be-a3e8-5906209ec736', '53db9c31-98ef-485c-8194-b63ffc2409cf', 'd4b9e5db-b34e-4979-9850-426ebce376d9', '1dc0a62b-a41a-4ffb-b077-307819eaf1b6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Delete snapshot completed successfully. Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-666eb1f0-68ec-44f8-92c8-a5efe4a2fc9e-delete_snapshot" released by "delete_snapshot" :: held 4.464s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Deleting offline snapshot dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa of volume 47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] snapshot_file for this snap is: volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[64940d6e-ea00-4a39-bafe-6dec96a01b77]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:33 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa Nov 05 15:06:33 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:34 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a599320-371d-4637-ba34-695f81899e91]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:34 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:34 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:34 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.549s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:34 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa Nov 05 15:06:34 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:35 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" returned: 0 in 0.567s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:35 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa Nov 05 15:06:35 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:35 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1.dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" returned: 0 in 0.489s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa" released by "_delete_snapshot" :: held 2.331s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" released by "delete_snapshot" :: held 2.386s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Created reservations ['874d0ab6-ba38-40d8-a857-d2931a701cf8', 'e46e7b89-65d1-4327-90d7-8da742541ee2', 'efda6704-bfed-4991-97d0-1f6caa881b80', '114e8b3a-7504-43f1-8068-dc4d072b496a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Delete snapshot completed successfully. Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-dbccfcd3-d27d-4f47-a87c-47b4a7b87cfa-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Snapshots deleted, issuing volume delete {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d867fc8-5e41-4e4f-a0b3-9831c5107b5c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:36 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:36 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:36 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.586s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:36 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1 Nov 05 15:06:36 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:37 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1" released by "delete_volume" :: held 1.179s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Created reservations ['7dbff69e-3425-4cab-b6e1-923ed886c6f9', '8e34e53c-1ad3-46d2-819b-3903f557b640', 'b72d9859-77e0-485c-932c-e70a642cdda6', '33f1d42b-f433-4d0e-ae2c-38f7967557b7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:37 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:37 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:37 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.492s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Deleted volume successfully. Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4b5e71c8-015b-4ed4-8939-19b122d5c4f4 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-47f3a6cd-4b93-45fd-9cf4-66812c9c58c1-delete_volume" released by "delete_volume" :: held 9.175s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Flow 'volume_create_manager' (3448d85b-e16a-44e8-911c-14674b9bfb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac91ca3-860c-4de4-b65b-a374e4f93423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac91ca3-860c-4de4-b65b-a374e4f93423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2143683629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090da68f-3be9-4168-b30a-665fc76baf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66fb797ba9d4253b659a88b77550189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:38Z,use_quota=True,user_id='75bf97a48bfd47e1919c2e58557ffa51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a723c2-9968-4f63-9388-e0ccfcae50b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a723c2-9968-4f63-9388-e0ccfcae50b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f768381a-36da-4a8b-b9f7-d1d7589a764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f768381a-36da-4a8b-b9f7-d1d7589a764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090da68f-3be9-4168-b30a-665fc76baf05', 'volume_name': 'volume-090da68f-3be9-4168-b30a-665fc76baf05', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13317980-b4c3-43ab-ac0c-769966bf5244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13317980-b4c3-43ab-ac0c-769966bf5244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc394d34-9f86-4fed-b310-4226aa9b2f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Volume 090da68f-3be9-4168-b30a-665fc76baf05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090da68f-3be9-4168-b30a-665fc76baf05', 'volume_size': 2} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2143683629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090da68f-3be9-4168-b30a-665fc76baf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f66fb797ba9d4253b659a88b77550189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:38Z,use_quota=True,user_id='75bf97a48bfd47e1919c2e58557ffa51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Creating volume 090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:06:38 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:06:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 2147483648 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:38 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 2147483648 Nov 05 15:06:38 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:39 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:39 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:39 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 2147483648" returned: 0 in 1.038s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Flow 'volume_create_manager' (507550da-42b9-42a9-917d-98f8e38e091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1319d11c-09a3-4ccc-9a88-16e9b29ba32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1319d11c-09a3-4ccc-9a88-16e9b29ba32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2088861304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b663ef60-c520-4a7b-bde4-ab61d08ad7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f57a7271243fab3ad8d5ac0084408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:39Z,use_quota=True,user_id='a65391650d65465dba3ef0b4c753a4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d368047d-315e-4378-9e15-76107f31d1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:39 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 Nov 05 15:06:39 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:39 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d368047d-315e-4378-9e15-76107f31d1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1d13a8-ec47-4dbe-bd52-536e0bb881d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1d13a8-ec47-4dbe-bd52-536e0bb881d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b663ef60-c520-4a7b-bde4-ab61d08ad7fc', 'volume_name': 'volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95c5802-e87e-427b-a59e-39bc14b814c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95c5802-e87e-427b-a59e-39bc14b814c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99472940-8ac6-4602-9a4e-0d9a44a205cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Volume b663ef60-c520-4a7b-bde4-ab61d08ad7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc', 'volume_size': 1} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.639s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:06:39 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2088861304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b663ef60-c520-4a7b-bde4-ab61d08ad7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f57a7271243fab3ad8d5ac0084408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:39Z,use_quota=True,user_id='a65391650d65465dba3ef0b4c753a4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Creating volume b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:06:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:06:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc394d34-9f86-4fed-b310-4226aa9b2f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090da68f-3be9-4168-b30a-665fc76baf05', 'volume_size': 2}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d787a8cb-fc4c-4959-b7e2-2e58255a0620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:40 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc 1073741824 Nov 05 15:06:40 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Volume volume-090da68f-3be9-4168-b30a-665fc76baf05 (090da68f-3be9-4168-b30a-665fc76baf05): created successfully Nov 05 15:06:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d787a8cb-fc4c-4959-b7e2-2e58255a0620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Flow 'volume_create_manager' (3448d85b-e16a-44e8-911c-14674b9bfb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-74650e6c-4ec4-47c0-a78c-bfdc85c0ac1a tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Created volume successfully. Nov 05 15:06:41 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc 1073741824" returned: 0 in 1.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:41 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc Nov 05 15:06:41 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:42 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" returned: 0 in 0.774s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.849s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Creating offline snapshot 6f6a66e3-54c6-439b-a678-662bc7c27abf of volume 090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99472940-8ac6-4602-9a4e-0d9a44a205cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff34a78-4f32-41d3-921c-8eb0cdd12f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7108a66-f915-4170-85f8-09b7b6b701b6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Volume volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc (b663ef60-c520-4a7b-bde4-ab61d08ad7fc): created successfully Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff34a78-4f32-41d3-921c-8eb0cdd12f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Flow 'volume_create_manager' (507550da-42b9-42a9-917d-98f8e38e091f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa893823-46fb-45c1-bc56-962cec6689ea tempest-VolumesDeleteCascade-1470222884 None] Created volume successfully. Nov 05 15:06:42 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 Nov 05 15:06:42 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:43 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05" returned: 0 in 0.839s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf 2G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:43 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf 2G Nov 05 15:06:43 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:44 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf 2G" returned: 0 in 1.189s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090da68f-3be9-4168-b30a-665fc76baf05 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:44 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090da68f-3be9-4168-b30a-665fc76baf05 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf Nov 05 15:06:44 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:45 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090da68f-3be9-4168-b30a-665fc76baf05 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf" returned: 0 in 0.859s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf is being set with open permissions: ugo+rw Nov 05 15:06:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:45 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf Nov 05 15:06:45 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:45 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:45 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info Nov 05 15:06:45 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:45 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info is being set with open permissions: ugo+rw Nov 05 15:06:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:46 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info Nov 05 15:06:46 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:46 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.info" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.360s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.494s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Creating offline snapshot 56d1a6ed-9a20-4641-b87c-221452c7dc9b of volume b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:06:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-93d1958d-2c2c-46a0-a914-cb7f2c983af8 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Create snapshot completed successfully Nov 05 15:06:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db5e86-998c-4648-8009-72203d121a31]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:46 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc Nov 05 15:06:46 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:47 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" returned: 0 in 0.818s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:47 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b 1G Nov 05 15:06:47 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "cinder-6f6a66e3-54c6-439b-a678-662bc7c27abf-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-6f6a66e3-54c6-439b-a678-662bc7c27abf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "cinder-quobyte-090da68f-3be9-4168-b30a-665fc76baf05" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-quobyte-090da68f-3be9-4168-b30a-665fc76baf05" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "cinder-quobyte-6f6a66e3-54c6-439b-a678-662bc7c27abf" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-quobyte-6f6a66e3-54c6-439b-a678-662bc7c27abf" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Deleting offline snapshot 6f6a66e3-54c6-439b-a678-662bc7c27abf of volume 090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] snapshot_file for this snap is: volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff46230-9d48-455e-8a76-cd0252db9b81]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:48 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf Nov 05 15:06:48 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:48 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b 1G" returned: 0 in 1.025s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:48 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b Nov 05 15:06:48 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf" returned: 0 in 0.795s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090da68f-3be9-4168-b30a-665fc76baf05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:48 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[578fbcd9-31b5-418f-a1ee-8712d0d72e27]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:49 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b" returned: 0 in 0.670s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:49 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b is being set with open permissions: ugo+rw Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:49 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 Nov 05 15:06:49 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:49 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b Nov 05 15:06:49 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:49 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05" returned: 0 in 0.601s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:49 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b" returned: 0 in 0.495s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:49 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf Nov 05 15:06:49 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:49 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info Nov 05 15:06:49 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:50 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:50 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info is being set with open permissions: ugo+rw Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:50 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info Nov 05 15:06:50 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:50 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:50 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf Nov 05 15:06:50 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:50 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.info" returned: 0 in 0.479s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e7407875-38df-4f40-ae41-5cbe8c46a21a tempest-VolumesDeleteCascade-1470222884 None] Create snapshot completed successfully Nov 05 15:06:50 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05.6f6a66e3-54c6-439b-a678-662bc7c27abf" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-quobyte-6f6a66e3-54c6-439b-a678-662bc7c27abf" released by "_delete_snapshot" :: held 2.707s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-quobyte-090da68f-3be9-4168-b30a-665fc76baf05" released by "delete_snapshot" :: held 2.754s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Created reservations ['ea961057-f422-4740-bc00-d1eb3146a5d2', 'c7c5f163-d0b0-4e9d-a503-09a2e6977f56', '49f9a42a-9981-4d95-a1ad-fb0a6016f618', 'c93c2de3-fdb1-44be-897b-71d639e111c8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Delete snapshot completed successfully. Nov 05 15:06:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ae21fcd2-5070-4907-9248-1a2c140bff40 tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-6f6a66e3-54c6-439b-a678-662bc7c27abf-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "cinder-090da68f-3be9-4168-b30a-665fc76baf05-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-090da68f-3be9-4168-b30a-665fc76baf05-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "cinder-quobyte-090da68f-3be9-4168-b30a-665fc76baf05" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-quobyte-090da68f-3be9-4168-b30a-665fc76baf05" acquired by "delete_volume" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d27f79-fc6b-4ad5-8655-fde66c311020]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:51 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 Nov 05 15:06:51 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:52 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05" returned: 0 in 0.873s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:52 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05 Nov 05 15:06:52 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Flow 'volume_create_manager' (d52fe343-2249-4ddb-80f6-49406e40acd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66d7008-acd1-431a-b32a-583b2a4c3160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66d7008-acd1-431a-b32a-583b2a4c3160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-130471267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4632254-11ff-410e-b5c3-94dd70b8af8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd1f57a7271243fab3ad8d5ac0084408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=56d1a6ed-9a20-4641-b87c-221452c7dc9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:53Z,use_quota=True,user_id='a65391650d65465dba3ef0b4c753a4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019a55ab-2987-4a18-8580-5dc118056d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019a55ab-2987-4a18-8580-5dc118056d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99c1a68-b74a-4763-8deb-c8ef9bbf1a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99c1a68-b74a-4763-8deb-c8ef9bbf1a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4632254-11ff-410e-b5c3-94dd70b8af8f', 'volume_name': 'volume-d4632254-11ff-410e-b5c3-94dd70b8af8f', 'volume_size': 1, 'snapshot_id': '56d1a6ed-9a20-4641-b87c-221452c7dc9b'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ea6c2-efde-4c00-b081-56019c54daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ea6c2-efde-4c00-b081-56019c54daad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:53 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a6c98b-6620-4519-9178-265660fd300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Volume d4632254-11ff-410e-b5c3-94dd70b8af8f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4632254-11ff-410e-b5c3-94dd70b8af8f', 'volume_size': 1, 'snapshot_id': '56d1a6ed-9a20-4641-b87c-221452c7dc9b'} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-090da68f-3be9-4168-b30a-665fc76baf05" returned: 0 in 0.868s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-56d1a6ed-9a20-4641-b87c-221452c7dc9b-d4632254-11ff-410e-b5c3-94dd70b8af8f" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-quobyte-090da68f-3be9-4168-b30a-665fc76baf05" released by "delete_volume" :: held 1.939s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-56d1a6ed-9a20-4641-b87c-221452c7dc9b-d4632254-11ff-410e-b5c3-94dd70b8af8f" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Creating volume d4632254-11ff-410e-b5c3-94dd70b8af8f from snapshot 56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-d4632254-11ff-410e-b5c3-94dd70b8af8f" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-d4632254-11ff-410e-b5c3-94dd70b8af8f" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] snapshot: 56d1a6ed-9a20-4641-b87c-221452c7dc9b, volume: d4632254-11ff-410e-b5c3-94dd70b8af8f, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c964fd-0e87-41bf-9b22-966f5b01cd94]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Created reservations ['d6e1c5a2-b48d-4dfb-aaa3-5e087044e3b1', '384a1157-f8db-4967-874f-0fce0400c149', '66ef3574-dc2e-4345-b513-be0a5986b620', '2f5df932-79ea-4c8d-a43c-ff32b160de74'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:06:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:53 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:06:53 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:53 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b Nov 05 15:06:53 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Flow 'volume_create_manager' (00976912-78b6-464c-b506-316fc9a8f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b14d06-54c1-4652-a7d1-37a07b54ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b14d06-54c1-4652-a7d1-37a07b54ed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2133236899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aef2df-2edc-4012-ae27-0a5faa0b5585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c5c3fba164152842d37273234e36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:54Z,use_quota=True,user_id='b23147ac8ba24d7985e79a4a9626179d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bc1237-4030-428a-af3e-dc6eab4d7aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bc1237-4030-428a-af3e-dc6eab4d7aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bc1420-d551-4b41-98e1-f33709222a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bc1420-d551-4b41-98e1-f33709222a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81aef2df-2edc-4012-ae27-0a5faa0b5585', 'volume_name': 'volume-81aef2df-2edc-4012-ae27-0a5faa0b5585', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c18933-f781-4dd9-8c15-f1baf93bb231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c18933-f781-4dd9-8c15-f1baf93bb231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0229e-4858-4fbb-9ea4-5effcb5edee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:06:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Volume 81aef2df-2edc-4012-ae27-0a5faa0b5585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81aef2df-2edc-4012-ae27-0a5faa0b5585', 'volume_size': 1} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:06:54 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.686s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:06:54 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b" returned: 0 in 0.898s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:06:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Deleted volume successfully. Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b9611c-b795-465d-9a1d-2e82ec9074e6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-364fede8-0ab2-407c-bcb3-e5930bf7c48e tempest-VolumesSnapshotNegativeTestJSON-1743644296 None] Lock "cinder-090da68f-3be9-4168-b30a-665fc76baf05-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:06:54 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc Nov 05 15:06:54 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:06:55 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Nov 05 15:06:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" returned: 0 in 0.773s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:06:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:06:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:06:55 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:06:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:06:55 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f Nov 05 15:06:55 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:04 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=99,cinder:INSERT=26,cinder:SELECT=73,cinder:DELETE=9 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:07:04 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=96,cinder:UPDATE=93,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:07:06 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f" returned: 0 in 11.084s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc, size 1024.00 MB, duration 11.09 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:07:06 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Converted 1024.00 MB image at 92.37 MB/s Nov 05 15:07:06 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f is being set with open permissions: ugo+rw Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:06 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f Nov 05 15:07:06 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:06 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-d4632254-11ff-410e-b5c3-94dd70b8af8f" released by "_copy_volume_from_snapshot" :: held 13.309s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-56d1a6ed-9a20-4641-b87c-221452c7dc9b-d4632254-11ff-410e-b5c3-94dd70b8af8f" released by "_create_volume_from_snapshot" :: held 13.434s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.469s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.627s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2133236899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81aef2df-2edc-4012-ae27-0a5faa0b5585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07c5c3fba164152842d37273234e36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:06:54Z,use_quota=True,user_id='b23147ac8ba24d7985e79a4a9626179d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Creating volume 81aef2df-2edc-4012-ae27-0a5faa0b5585 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:07 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 1073741824 Nov 05 15:07:07 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a6c98b-6620-4519-9178-265660fd300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4632254-11ff-410e-b5c3-94dd70b8af8f', 'volume_size': 1, 'snapshot_id': '56d1a6ed-9a20-4641-b87c-221452c7dc9b'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccd50a0-394e-4782-8ce4-bba6dc445f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Volume volume-d4632254-11ff-410e-b5c3-94dd70b8af8f (d4632254-11ff-410e-b5c3-94dd70b8af8f): created successfully Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccd50a0-394e-4782-8ce4-bba6dc445f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Flow 'volume_create_manager' (d52fe343-2249-4ddb-80f6-49406e40acd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9ca8ae76-7456-4fe4-ab8e-0bb675b78ad9 tempest-VolumesDeleteCascade-1470222884 None] Created volume successfully. Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-b663ef60-c520-4a7b-bde4-ab61d08ad7fc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-b663ef60-c520-4a7b-bde4-ab61d08ad7fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Performing cascade delete. {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-56d1a6ed-9a20-4641-b87c-221452c7dc9b-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-56d1a6ed-9a20-4641-b87c-221452c7dc9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:07 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 1073741824" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-56d1a6ed-9a20-4641-b87c-221452c7dc9b" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-56d1a6ed-9a20-4641-b87c-221452c7dc9b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Deleting offline snapshot 56d1a6ed-9a20-4641-b87c-221452c7dc9b of volume b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] snapshot_file for this snap is: volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eec2e2-bfb9-4ed7-8283-17b3715a8c66]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:07 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 Nov 05 15:07:07 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:07 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b Nov 05 15:07:07 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Flow 'volume_create_manager' (220a04e6-d992-4f3e-824e-c53912870dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3ac7c3-3e2d-4061-b482-44789a72ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3ac7c3-3e2d-4061-b482-44789a72ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1443052032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41469a1-8767-43c9-a36d-6ac63884a3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df27d95107f4e3081d2e08ff44d2e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:08Z,use_quota=True,user_id='090f14ff87714a47be24009ed3fef3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99dfe0b-fcbe-4a3d-bebc-e293f670ecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d99dfe0b-fcbe-4a3d-bebc-e293f670ecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e847af-a455-431c-b0e4-f04b6ca41a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:08 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e847af-a455-431c-b0e4-f04b6ca41a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41469a1-8767-43c9-a36d-6ac63884a3f7', 'volume_name': 'volume-c41469a1-8767-43c9-a36d-6ac63884a3f7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f72fd19-bf33-4bea-950f-57ef9ab112cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f72fd19-bf33-4bea-950f-57ef9ab112cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4226d78-9aae-407a-9ee8-eec907a2ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Volume c41469a1-8767-43c9-a36d-6ac63884a3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41469a1-8767-43c9-a36d-6ac63884a3f7', 'volume_size': 1} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1443052032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41469a1-8767-43c9-a36d-6ac63884a3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df27d95107f4e3081d2e08ff44d2e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:08Z,use_quota=True,user_id='090f14ff87714a47be24009ed3fef3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Creating volume c41469a1-8767-43c9-a36d-6ac63884a3f7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:08 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0229e-4858-4fbb-9ea4-5effcb5edee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81aef2df-2edc-4012-ae27-0a5faa0b5585', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c8e307-53c6-4ee0-a3eb-99bbe2fcdc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:08 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 1073741824 Nov 05 15:07:08 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Volume volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 (81aef2df-2edc-4012-ae27-0a5faa0b5585): created successfully Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c8e307-53c6-4ee0-a3eb-99bbe2fcdc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Flow 'volume_create_manager' (00976912-78b6-464c-b506-316fc9a8f73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dd823f84-578c-452d-8a56-872ebd016dc0 tempest-ServerRescueNegativeTestJSON-2119238746 None] Created volume successfully. Nov 05 15:07:08 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f79434-d163-4476-a191-d04a23dd43f2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:08 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc Nov 05 15:07:08 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:08 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 1073741824" returned: 0 in 0.506s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:08 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 Nov 05 15:07:08 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:08 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:08 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b Nov 05 15:07:08 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:08 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4226d78-9aae-407a-9ee8-eec907a2ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41469a1-8767-43c9-a36d-6ac63884a3f7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8c61d4-8d99-4821-a571-d3d1c8e7b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Volume volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 (c41469a1-8767-43c9-a36d-6ac63884a3f7): created successfully Nov 05 15:07:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8c61d4-8d99-4821-a571-d3d1c8e7b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Flow 'volume_create_manager' (220a04e6-d992-4f3e-824e-c53912870dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d8e0fd79-cc1f-4df3-a0d8-fd9336c430b1 tempest-VolumesListAdminTestJSON-268105957 None] Created volume successfully. Nov 05 15:07:09 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:09 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b Nov 05 15:07:09 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:09 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc.56d1a6ed-9a20-4641-b87c-221452c7dc9b" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-56d1a6ed-9a20-4641-b87c-221452c7dc9b" released by "_delete_snapshot" :: held 1.928s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" released by "delete_snapshot" :: held 1.969s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Created reservations ['d694d75a-d57b-4894-b5f4-5971d24551b8', 'f85668af-87a6-40a6-ba53-d77ac4275c2b', 'bc063a99-fa01-4b4c-9dc5-4bb5bc65bd1a', 'ddd83f56-d9a4-4e0e-b8d3-df9b9a243f97'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Delete snapshot completed successfully. Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-56d1a6ed-9a20-4641-b87c-221452c7dc9b-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Snapshots deleted, issuing volume delete {{(pid=87126) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b90d99e-ba7a-4c04-94a9-bc739df097f0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:09 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc Nov 05 15:07:09 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:10 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" returned: 0 in 0.534s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:10 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc Nov 05 15:07:10 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:10 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-b663ef60-c520-4a7b-bde4-ab61d08ad7fc" released by "delete_volume" :: held 0.959s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Flow 'volume_create_manager' (42dde205-ac41-46cb-b73f-62441865565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51475553-c724-401f-b2c7-f0defd151e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Created reservations ['25617363-607b-4c52-817d-818cdc1ba3a4', '22f9dbca-bdf1-4024-9bc3-e8d81f9b5cc3', 'dcdaefa4-36af-4871-9663-a4447b8207d0', 'dcdbbeb2-3207-41a5-98dc-277cc04c93ea'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51475553-c724-401f-b2c7-f0defd151e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2098548238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3658013-596e-433c-bd19-1aff6f32ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df27d95107f4e3081d2e08ff44d2e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:11Z,use_quota=True,user_id='090f14ff87714a47be24009ed3fef3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dacc637-2f7d-45d3-8049-df332fef270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dacc637-2f7d-45d3-8049-df332fef270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d5f6fe-4719-4fee-b66f-947e8d960481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d5f6fe-4719-4fee-b66f-947e8d960481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3658013-596e-433c-bd19-1aff6f32ed92', 'volume_name': 'volume-b3658013-596e-433c-bd19-1aff6f32ed92', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb1abb2-73ec-4dfe-9d0a-e935225a3428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb1abb2-73ec-4dfe-9d0a-e935225a3428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360d6d3d-c187-4775-81e0-9c52d2a794ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Volume b3658013-596e-433c-bd19-1aff6f32ed92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3658013-596e-433c-bd19-1aff6f32ed92', 'volume_size': 1} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2098548238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3658013-596e-433c-bd19-1aff6f32ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df27d95107f4e3081d2e08ff44d2e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:11Z,use_quota=True,user_id='090f14ff87714a47be24009ed3fef3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Creating volume b3658013-596e-433c-bd19-1aff6f32ed92 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:11 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:11 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 1073741824 Nov 05 15:07:11 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:11 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:11 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:11 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Deleted volume successfully. Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b69b0563-88d6-462e-80cc-ebd9fe04d4ef tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-b663ef60-c520-4a7b-bde4-ab61d08ad7fc-delete_volume" released by "delete_volume" :: held 4.171s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:11 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 1073741824" returned: 0 in 0.674s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:11 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 Nov 05 15:07:11 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:12 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-d4632254-11ff-410e-b5c3-94dd70b8af8f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360d6d3d-c187-4775-81e0-9c52d2a794ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3658013-596e-433c-bd19-1aff6f32ed92', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94c7973-4742-41d6-ab56-cd9be32b9a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-d4632254-11ff-410e-b5c3-94dd70b8af8f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Volume volume-b3658013-596e-433c-bd19-1aff6f32ed92 (b3658013-596e-433c-bd19-1aff6f32ed92): created successfully Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94c7973-4742-41d6-ab56-cd9be32b9a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Flow 'volume_create_manager' (42dde205-ac41-46cb-b73f-62441865565d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-862b083f-1c2d-4233-a684-84c627e35718 tempest-VolumesListAdminTestJSON-268105957 None] Created volume successfully. Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "cinder-quobyte-d4632254-11ff-410e-b5c3-94dd70b8af8f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-d4632254-11ff-410e-b5c3-94dd70b8af8f" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a041726-7fc7-474e-9284-ac90aa3a330b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:12 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f Nov 05 15:07:12 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:13 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f" returned: 0 in 0.647s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:13 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f Nov 05 15:07:13 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:13 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d4632254-11ff-410e-b5c3-94dd70b8af8f" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-quobyte-d4632254-11ff-410e-b5c3-94dd70b8af8f" released by "delete_volume" :: held 1.225s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Created reservations ['118ac0e4-5df0-451e-a155-a1e5eb4bba8e', '4a3990ae-def5-472b-96dd-5fa2d4970cb1', '38a3b3da-d550-4eb2-902e-039ebda3de28', '09ddc6ea-1145-47f8-9e89-811b65d0f05f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:13 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:13 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:14 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Deleted volume successfully. Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Flow 'volume_create_manager' (d9888c19-fe76-4485-bd6f-ad4c551b0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e7b886-2ac0-427f-8665-5a49e217f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e7b886-2ac0-427f-8665-5a49e217f181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-804956562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac79ee6-f98c-43c9-bf7a-55a06caabd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df27d95107f4e3081d2e08ff44d2e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:14Z,use_quota=True,user_id='090f14ff87714a47be24009ed3fef3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a4f053-c7df-4958-944f-86182d5e8f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a4f053-c7df-4958-944f-86182d5e8f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb698f5f-3f80-415e-8b47-3a48e76ab131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb698f5f-3f80-415e-8b47-3a48e76ab131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac79ee6-f98c-43c9-bf7a-55a06caabd44', 'volume_name': 'volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c89b5b-1022-4ed4-9ee4-926b786c2817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c89b5b-1022-4ed4-9ee4-926b786c2817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edf4071-645c-4fab-bf1a-57c3ae690d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Volume 4ac79ee6-f98c-43c9-bf7a-55a06caabd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44', 'volume_size': 1} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-804956562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac79ee6-f98c-43c9-bf7a-55a06caabd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df27d95107f4e3081d2e08ff44d2e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:14Z,use_quota=True,user_id='090f14ff87714a47be24009ed3fef3a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Creating volume 4ac79ee6-f98c-43c9-bf7a-55a06caabd44 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:14 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-029e0687-380a-4d98-8b5e-f5903671dcd5 tempest-VolumesDeleteCascade-1470222884 None] Lock "cinder-d4632254-11ff-410e-b5c3-94dd70b8af8f-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:14 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 1073741824 Nov 05 15:07:14 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:15 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 1073741824" returned: 0 in 1.175s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:15 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 Nov 05 15:07:15 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:16 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edf4071-645c-4fab-bf1a-57c3ae690d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c84e0f-98c7-481b-9580-d1a678eb7e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Volume volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 (4ac79ee6-f98c-43c9-bf7a-55a06caabd44): created successfully Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c84e0f-98c7-481b-9580-d1a678eb7e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Flow 'volume_create_manager' (d9888c19-fe76-4485-bd6f-ad4c551b0f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6f923a8f-bc04-48ca-8eb2-bebeea2712bd tempest-VolumesListAdminTestJSON-268105957 None] Created volume successfully. Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Flow 'volume_create_manager' (b6be621c-91d8-4782-b3d4-2019ced8c267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c0e902-82f1-4795-81ad-2475167b73ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c0e902-82f1-4795-81ad-2475167b73ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f84cb89-499b-472e-811a-08196a4cf7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de0498dc4324a6ebf3ef3b0c91036f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:19Z,use_quota=True,user_id='9dbf4e76848441adb933c56b7973792b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2070b27-b6fa-4561-8a3a-63582d4ace7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2070b27-b6fa-4561-8a3a-63582d4ace7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d2bdcb-55c2-40b4-b621-f7a2506f9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d2bdcb-55c2-40b4-b621-f7a2506f9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f84cb89-499b-472e-811a-08196a4cf7c1', 'volume_name': 'volume-7f84cb89-499b-472e-811a-08196a4cf7c1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b031f5e7-71f8-485f-bd51-ef03dd84b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b031f5e7-71f8-485f-bd51-ef03dd84b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56009397-39e2-44b5-b4b5-80d069d6a521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Volume 7f84cb89-499b-472e-811a-08196a4cf7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f84cb89-499b-472e-811a-08196a4cf7c1', 'volume_size': 1} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f84cb89-499b-472e-811a-08196a4cf7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8de0498dc4324a6ebf3ef3b0c91036f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:19Z,use_quota=True,user_id='9dbf4e76848441adb933c56b7973792b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Creating volume 7f84cb89-499b-472e-811a-08196a4cf7c1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:19 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 1073741824 Nov 05 15:07:19 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:20 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 1073741824" returned: 0 in 0.969s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:20 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 Nov 05 15:07:20 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1" returned: 0 in 0.616s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:21 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56009397-39e2-44b5-b4b5-80d069d6a521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f84cb89-499b-472e-811a-08196a4cf7c1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb73da5-3070-4ea7-af9f-ed444ec63a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Volume volume-7f84cb89-499b-472e-811a-08196a4cf7c1 (7f84cb89-499b-472e-811a-08196a4cf7c1): created successfully Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb73da5-3070-4ea7-af9f-ed444ec63a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Flow 'volume_create_manager' (b6be621c-91d8-4782-b3d4-2019ced8c267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b6c9a8eb-c936-43e1-8a8c-76d32abb6a73 tempest-VolumesListAdminTestJSON-258715736 None] Created volume successfully. Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Acquiring lock "cinder-7f84cb89-499b-472e-811a-08196a4cf7c1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Lock "cinder-7f84cb89-499b-472e-811a-08196a4cf7c1-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Acquiring lock "cinder-quobyte-7f84cb89-499b-472e-811a-08196a4cf7c1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Lock "cinder-quobyte-7f84cb89-499b-472e-811a-08196a4cf7c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b22a0bd-1023-4fcb-bb7e-f9431d0ad8c3]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "cinder-4ac79ee6-f98c-43c9-bf7a-55a06caabd44-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-4ac79ee6-f98c-43c9-bf7a-55a06caabd44-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "cinder-quobyte-4ac79ee6-f98c-43c9-bf7a-55a06caabd44" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-quobyte-4ac79ee6-f98c-43c9-bf7a-55a06caabd44" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:22 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 Nov 05 15:07:22 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f396cec-c643-409e-a405-e577309aadb0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:22 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 Nov 05 15:07:22 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:22 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1" returned: 0 in 0.799s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:22 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1 Nov 05 15:07:22 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:23 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44" returned: 0 in 0.646s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:23 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44 Nov 05 15:07:23 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:23 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7f84cb89-499b-472e-811a-08196a4cf7c1" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Lock "cinder-quobyte-7f84cb89-499b-472e-811a-08196a4cf7c1" released by "delete_volume" :: held 1.285s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Created reservations ['30b36dea-ae71-4f84-9463-72a11c02222f', 'cf349d19-3928-423c-809f-ba0748fc5b3d', '3b1ab3de-f130-40bf-a1e3-483d8609db98', 'd6bfb395-e307-4bd7-b261-eef4561f2ebf'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:23 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4ac79ee6-f98c-43c9-bf7a-55a06caabd44" returned: 0 in 0.622s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-quobyte-4ac79ee6-f98c-43c9-bf7a-55a06caabd44" released by "delete_volume" :: held 1.356s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:23 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:23 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Created reservations ['77a07f9a-9e00-4ad2-9385-561f36dec8dc', '8d646f90-60a5-4a63-aae5-3e5f8c7c17d0', '03c3be6c-f4f5-46a8-9844-a46880854059', 'f6927016-bb78-4ce4-85ae-a2b3d6660423'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Acquiring lock "cinder-81aef2df-2edc-4012-ae27-0a5faa0b5585-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:24 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:24 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "cinder-81aef2df-2edc-4012-ae27-0a5faa0b5585-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:24 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.510s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Deleted volume successfully. Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Acquiring lock "cinder-quobyte-81aef2df-2edc-4012-ae27-0a5faa0b5585" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3710447e-d7a3-446d-b3c8-4b4a7bdbf065 tempest-VolumesListAdminTestJSON-258715736 None] Lock "cinder-7f84cb89-499b-472e-811a-08196a4cf7c1-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "cinder-quobyte-81aef2df-2edc-4012-ae27-0a5faa0b5585" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10b497f-1ced-4643-971b-a9ad4c7b5906]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:24 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 Nov 05 15:07:24 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:24 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.558s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Deleted volume successfully. Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-13958bed-5b48-4836-8af9-c67efd48df82 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-4ac79ee6-f98c-43c9-bf7a-55a06caabd44-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "cinder-b3658013-596e-433c-bd19-1aff6f32ed92-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-b3658013-596e-433c-bd19-1aff6f32ed92-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "cinder-quobyte-b3658013-596e-433c-bd19-1aff6f32ed92" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-quobyte-b3658013-596e-433c-bd19-1aff6f32ed92" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:24 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585" returned: 0 in 0.601s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ad4076-48ad-4e0f-b483-f5bc4d94fc9d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:25 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585 Nov 05 15:07:25 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:25 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 Nov 05 15:07:25 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:25 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-81aef2df-2edc-4012-ae27-0a5faa0b5585" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "cinder-quobyte-81aef2df-2edc-4012-ae27-0a5faa0b5585" released by "delete_volume" :: held 1.083s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Created reservations ['092eedef-9dbc-4b61-b89d-eceddf02662a', 'd254553e-ca55-4a2e-bf43-ec0ddf965dc1', '4f16941e-3b57-426c-8600-c71bff6d81ae', '8be6806c-669d-437e-9237-8b5ac6fb3262'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:25 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92" returned: 0 in 0.605s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:25 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92 Nov 05 15:07:25 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:25 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:25 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:25 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3658013-596e-433c-bd19-1aff6f32ed92" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-quobyte-b3658013-596e-433c-bd19-1aff6f32ed92" released by "delete_volume" :: held 1.065s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Created reservations ['88ed46dd-848e-4666-a063-fe28e1c3dc54', '5ca5ad3d-693d-4fd8-a741-7bea41c5e601', '4320d3fe-65a6-4a95-91d2-b6197614cb66', '47f850f3-2e90-4a64-a4fd-eecbb4f90e94'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:26 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Deleted volume successfully. Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6b9d3339-b170-46f4-bfab-d35eecab281f tempest-ServerRescueNegativeTestJSON-2119238746 None] Lock "cinder-81aef2df-2edc-4012-ae27-0a5faa0b5585-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:26 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:26 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:26 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.398s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Deleted volume successfully. Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39019e25-b05f-42fe-8490-b6187b757272 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-b3658013-596e-433c-bd19-1aff6f32ed92-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Flow 'volume_create_manager' (69375c88-2fdf-453f-a729-1d880716377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba13ba9-578d-4b6c-a984-033bafc3d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba13ba9-578d-4b6c-a984-033bafc3d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-431744736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa519adc-d022-4431-aa0c-f23f7fb7a6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b874cd1534424921f0cf84cb56abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:27Z,use_quota=True,user_id='b234580fcc054c1d94e369985890dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3839ec3e-796e-4b78-bfff-9e30458721ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3839ec3e-796e-4b78-bfff-9e30458721ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1319df24-587a-49d1-b7e1-9bf8bb8acf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1319df24-587a-49d1-b7e1-9bf8bb8acf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa519adc-d022-4431-aa0c-f23f7fb7a6dc', 'volume_name': 'volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adabaff0-3543-4276-a2b0-9523c15ec179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adabaff0-3543-4276-a2b0-9523c15ec179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f20a0-69f3-4f31-8e30-4208add9b724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Volume fa519adc-d022-4431-aa0c-f23f7fb7a6dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc', 'volume_size': 1} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-431744736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa519adc-d022-4431-aa0c-f23f7fb7a6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b874cd1534424921f0cf84cb56abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:27Z,use_quota=True,user_id='b234580fcc054c1d94e369985890dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Creating volume fa519adc-d022-4431-aa0c-f23f7fb7a6dc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:27 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:27 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc 1073741824 Nov 05 15:07:27 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "cinder-c41469a1-8767-43c9-a36d-6ac63884a3f7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-c41469a1-8767-43c9-a36d-6ac63884a3f7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "cinder-quobyte-c41469a1-8767-43c9-a36d-6ac63884a3f7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-quobyte-c41469a1-8767-43c9-a36d-6ac63884a3f7" acquired by "delete_volume" :: waited 0.055s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66dd152-c430-48fb-ac69-39795b6fd960]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:28 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc 1073741824" returned: 0 in 1.113s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:28 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 Nov 05 15:07:28 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:28 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc Nov 05 15:07:28 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:28 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7" returned: 0 in 0.822s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:28 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7 Nov 05 15:07:28 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:29 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc" returned: 0 in 0.757s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259f20a0-69f3-4f31-8e30-4208add9b724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a110040-e03b-45be-a09d-142e6ab6db29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Volume volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc (fa519adc-d022-4431-aa0c-f23f7fb7a6dc): created successfully Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a110040-e03b-45be-a09d-142e6ab6db29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Flow 'volume_create_manager' (69375c88-2fdf-453f-a729-1d880716377a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e3852fcb-323c-447e-b0f6-01d61610eb00 tempest-VolumesTransfersV357Test-53465143 None] Created volume successfully. Nov 05 15:07:29 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c41469a1-8767-43c9-a36d-6ac63884a3f7" returned: 0 in 0.653s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-quobyte-c41469a1-8767-43c9-a36d-6ac63884a3f7" released by "delete_volume" :: held 1.538s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Created reservations ['63bcd010-816c-4191-afe9-63df182bc4aa', 'b3101e43-c46a-416b-8040-079680c3df09', '6b654e0f-f17d-4668-a50b-8bf4fca6e184', 'f945fec7-b37c-46fd-ab3b-1e73ab0b3f82'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:29 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:29 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:30 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.465s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Deleted volume successfully. Nov 05 15:07:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2b26c734-e68e-49d2-bfa7-602d53c0c7e1 tempest-VolumesListAdminTestJSON-268105957 None] Lock "cinder-c41469a1-8767-43c9-a36d-6ac63884a3f7-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6faac142-c9cb-4fa0-97a5-143d2e262011 tempest-VolumesTransfersV357Test-1768957183 None] Transfer volume completed successfully. Nov 05 15:07:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Acquiring lock "cinder-fa519adc-d022-4431-aa0c-f23f7fb7a6dc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-fa519adc-d022-4431-aa0c-f23f7fb7a6dc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Acquiring lock "cinder-quobyte-fa519adc-d022-4431-aa0c-f23f7fb7a6dc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-quobyte-fa519adc-d022-4431-aa0c-f23f7fb7a6dc" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[744f60e1-99b9-4899-ad84-6e2699a20487]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:33 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc Nov 05 15:07:33 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:33 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:33 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc Nov 05 15:07:33 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:33 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa519adc-d022-4431-aa0c-f23f7fb7a6dc" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-quobyte-fa519adc-d022-4431-aa0c-f23f7fb7a6dc" released by "delete_volume" :: held 0.757s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Created reservations ['6dbb6598-5781-4d5d-bca9-455156d0194c', 'cfefa77c-285e-4bf3-b7ff-32e0518fae2a', '758bc202-63a5-470b-8516-9c578de3d34c', '3bb0db35-0b91-4963-9fa4-e1c54006d197'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:33 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:33 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:34 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Deleted volume successfully. Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36b5197e-9f42-4330-828b-a83e5b20202e tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-fa519adc-d022-4431-aa0c-f23f7fb7a6dc-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Flow 'volume_create_manager' (84e74ec9-cd54-49ff-b1f0-e8c814e7ea07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43256eea-d6b9-40bf-9cb4-3ae039fd47de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43256eea-d6b9-40bf-9cb4-3ae039fd47de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-276646851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4dc3d4-aca6-4f10-9692-85f288f987f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b874cd1534424921f0cf84cb56abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:35Z,use_quota=True,user_id='b234580fcc054c1d94e369985890dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5f6c86-07d7-4001-a322-da1a07ce95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5f6c86-07d7-4001-a322-da1a07ce95bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a73c07-b1a8-4fad-854d-365c8fe42500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a73c07-b1a8-4fad-854d-365c8fe42500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4dc3d4-aca6-4f10-9692-85f288f987f1', 'volume_name': 'volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3547e5ed-726b-42a9-8231-aa580513e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3547e5ed-726b-42a9-8231-aa580513e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea41112-609a-46fa-94b4-5a8de9089fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Volume 9c4dc3d4-aca6-4f10-9692-85f288f987f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1', 'volume_size': 1} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-276646851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4dc3d4-aca6-4f10-9692-85f288f987f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b874cd1534424921f0cf84cb56abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:35Z,use_quota=True,user_id='b234580fcc054c1d94e369985890dfbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Creating volume 9c4dc3d4-aca6-4f10-9692-85f288f987f1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:34 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 1073741824 Nov 05 15:07:34 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:35 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 1073741824" returned: 0 in 0.670s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:35 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 Nov 05 15:07:35 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:35 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea41112-609a-46fa-94b4-5a8de9089fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11be2c3b-56fc-4906-a55f-845b80b22207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Volume volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 (9c4dc3d4-aca6-4f10-9692-85f288f987f1): created successfully Nov 05 15:07:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11be2c3b-56fc-4906-a55f-845b80b22207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Flow 'volume_create_manager' (84e74ec9-cd54-49ff-b1f0-e8c814e7ea07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9036a5bb-4136-451a-a2b1-d4e68ef6dccd tempest-VolumesTransfersV357Test-53465143 None] Created volume successfully. Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Acquiring lock "cinder-9c4dc3d4-aca6-4f10-9692-85f288f987f1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-9c4dc3d4-aca6-4f10-9692-85f288f987f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Acquiring lock "cinder-quobyte-9c4dc3d4-aca6-4f10-9692-85f288f987f1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-quobyte-9c4dc3d4-aca6-4f10-9692-85f288f987f1" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8252f10-8369-463f-8014-22a59be6ff15]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:37 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 Nov 05 15:07:37 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:37 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1" returned: 0 in 0.535s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:37 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1 Nov 05 15:07:37 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:38 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9c4dc3d4-aca6-4f10-9692-85f288f987f1" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-quobyte-9c4dc3d4-aca6-4f10-9692-85f288f987f1" released by "delete_volume" :: held 0.887s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Created reservations ['3a1d86b1-6db4-440d-8520-86d716e85c14', '501a9761-d513-4d28-8e81-37d7cb403d6d', '76ddf0d0-4728-408c-b115-16926aa2967e', 'f8c66488-e421-4b42-8ab9-90dd2e7b11a2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:38 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:38 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:38 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Deleted volume successfully. Nov 05 15:07:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1ab6f92b-1537-44d8-8485-d35f4280bc50 tempest-VolumesTransfersV357Test-1114683245 None] Lock "cinder-9c4dc3d4-aca6-4f10-9692-85f288f987f1-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:39 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:39 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:39 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.430s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:07:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Flow 'volume_create_manager' (b4819efe-04c3-4a28-8a49-635278261274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a7f74b-2cac-44d1-a615-de60019ecd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a7f74b-2cac-44d1-a615-de60019ecd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-633344128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d4e92b-a82f-46fe-9761-1f345149e5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3129c7780d57422ba42c4cc8fed6f0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:40Z,use_quota=True,user_id='dada7af0111a44ee82c3a6afbd13e5db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938419df-372b-494d-babb-f2a4975789ba),volume_type_id=938419df-372b-494d-babb-f2a4975789ba)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9159e17f-093a-437b-ad95-9693a9bf7264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9159e17f-093a-437b-ad95-9693a9bf7264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7059ff6a-3291-4e65-8ccd-49ac55ca9f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7059ff6a-3291-4e65-8ccd-49ac55ca9f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d4e92b-a82f-46fe-9761-1f345149e5f0', 'volume_name': 'volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1853d1-7ef1-4897-bd1d-11f431de0465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1853d1-7ef1-4897-bd1d-11f431de0465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5383d3-7791-4cd1-a63f-05b5fc79bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume e8d4e92b-a82f-46fe-9761-1f345149e5f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0', 'volume_size': 1} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-633344128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d4e92b-a82f-46fe-9761-1f345149e5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3129c7780d57422ba42c4cc8fed6f0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:40Z,use_quota=True,user_id='dada7af0111a44ee82c3a6afbd13e5db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(938419df-372b-494d-babb-f2a4975789ba),volume_type_id=938419df-372b-494d-babb-f2a4975789ba)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Creating volume e8d4e92b-a82f-46fe-9761-1f345149e5f0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:40 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 1073741824 Nov 05 15:07:40 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Flow 'volume_create_manager' (42abbd60-a111-4a44-93d9-80a95a3b1270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf83fcc-d0c3-46f8-82fc-b045afcbcc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf83fcc-d0c3-46f8-82fc-b045afcbcc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-768949230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ce76c8-6a50-464a-95ae-6c4d02ef73f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3129c7780d57422ba42c4cc8fed6f0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:41Z,use_quota=True,user_id='dada7af0111a44ee82c3a6afbd13e5db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2269db3-e394-47d9-9e31-3fb88c574939),volume_type_id=c2269db3-e394-47d9-9e31-3fb88c574939)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e785b3-7f88-4d1e-83de-81aaaf0ae7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81e785b3-7f88-4d1e-83de-81aaaf0ae7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6eda7c-e2d4-416a-8cbb-63ebe1394ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6eda7c-e2d4-416a-8cbb-63ebe1394ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ce76c8-6a50-464a-95ae-6c4d02ef73f7', 'volume_name': 'volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c298a4-a0c0-414f-acc1-f5aefc18f1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c298a4-a0c0-414f-acc1-f5aefc18f1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d81ff9c-3252-4e46-9a62-b8c6cc9274bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume 30ce76c8-6a50-464a-95ae-6c4d02ef73f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7', 'volume_size': 1} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:41 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 1073741824" returned: 0 in 0.923s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:41 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 Nov 05 15:07:41 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:41 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-768949230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ce76c8-6a50-464a-95ae-6c4d02ef73f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3129c7780d57422ba42c4cc8fed6f0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:41Z,use_quota=True,user_id='dada7af0111a44ee82c3a6afbd13e5db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2269db3-e394-47d9-9e31-3fb88c574939),volume_type_id=c2269db3-e394-47d9-9e31-3fb88c574939)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Creating volume 30ce76c8-6a50-464a-95ae-6c4d02ef73f7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:41 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 1073741824 Nov 05 15:07:41 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5383d3-7791-4cd1-a63f-05b5fc79bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d49b41-fa2d-4e98-b0c4-c76c87a677ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 (e8d4e92b-a82f-46fe-9761-1f345149e5f0): created successfully Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d49b41-fa2d-4e98-b0c4-c76c87a677ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Flow 'volume_create_manager' (b4819efe-04c3-4a28-8a49-635278261274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0f00d41e-a8a5-4572-9e6a-e98abd8e0c1b tempest-TestInstancesWithCinderVolumes-1985274593 None] Created volume successfully. Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Flow 'volume_create_manager' (01eac092-0542-4742-938b-6ee0b3df2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031e698a-5b7f-49ad-987d-16b433591e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031e698a-5b7f-49ad-987d-16b433591e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1540300911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef0e445-7e1b-4b1f-a6d0-3838fdc33944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ad8c3aeb8c4765ac86b86ac057e377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:42Z,use_quota=True,user_id='a39ce1233d4b44e897a8139d8dcfca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e3b526-91f4-455f-8f22-185bfb72de1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e3b526-91f4-455f-8f22-185bfb72de1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a42a4b-57ea-4fb4-811f-8ca11c19bb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a42a4b-57ea-4fb4-811f-8ca11c19bb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef0e445-7e1b-4b1f-a6d0-3838fdc33944', 'volume_name': 'volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38cd59c-88ea-415b-bd54-e0acec716dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38cd59c-88ea-415b-bd54-e0acec716dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e4fbf7-f188-4733-9f42-bdf84a2fca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Volume 8ef0e445-7e1b-4b1f-a6d0-3838fdc33944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944', 'volume_size': 1} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 1073741824" returned: 0 in 0.875s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Flow 'volume_create_manager' (b4ac471a-d68a-4145-965f-820b02ec72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e270331f-dc99-4d97-bdb4-a0c20cfbecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e270331f-dc99-4d97-bdb4-a0c20cfbecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-862754865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8692d62c-9a86-4f62-a760-b05c26f02f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3129c7780d57422ba42c4cc8fed6f0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:43Z,use_quota=True,user_id='dada7af0111a44ee82c3a6afbd13e5db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9172355a-e05c-4045-b04c-2c567da38ea1),volume_type_id=9172355a-e05c-4045-b04c-2c567da38ea1)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be5d958-7407-4852-9dee-173881b8d4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be5d958-7407-4852-9dee-173881b8d4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e725637d-6681-46ef-8abe-67fd5f3d2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:07:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:42 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 Nov 05 15:07:42 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:43 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1540300911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef0e445-7e1b-4b1f-a6d0-3838fdc33944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9ad8c3aeb8c4765ac86b86ac057e377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:42Z,use_quota=True,user_id='a39ce1233d4b44e897a8139d8dcfca9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Creating volume 8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:43 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d81ff9c-3252-4e46-9a62-b8c6cc9274bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:43 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 1073741824 Nov 05 15:07:43 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b488c3a8-9ee8-4d71-a23d-5fbe64d5f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 (30ce76c8-6a50-464a-95ae-6c4d02ef73f7): created successfully Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b488c3a8-9ee8-4d71-a23d-5fbe64d5f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Flow 'volume_create_manager' (42abbd60-a111-4a44-93d9-80a95a3b1270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a00ff6d8-2749-4b94-a996-aa443d1dfa18 tempest-TestInstancesWithCinderVolumes-1985274593 None] Created volume successfully. Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e725637d-6681-46ef-8abe-67fd5f3d2459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8692d62c-9a86-4f62-a760-b05c26f02f92', 'volume_name': 'volume-8692d62c-9a86-4f62-a760-b05c26f02f92', 'volume_size': 1, 'image_id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/642e66c5-0826-4b33-96a7-4c0e15d86022', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--509261430', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3129c7780d57422ba42c4cc8fed6f0fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'created_at': datetime.datetime(2026, 11, 5, 14, 7, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 7, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/642e66c5-0826-4b33-96a7-4c0e15d86022/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3191f36-eead-4a70-b037-506c11158a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3191f36-eead-4a70-b037-506c11158a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b2c7d-bb9d-43d5-ab3c-ebe67dff97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume 8692d62c-9a86-4f62-a760-b05c26f02f92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8692d62c-9a86-4f62-a760-b05c26f02f92', 'volume_size': 1, 'image_id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/642e66c5-0826-4b33-96a7-4c0e15d86022', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--509261430', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3129c7780d57422ba42c4cc8fed6f0fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'created_at': datetime.datetime(2026, 11, 5, 14, 7, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 7, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/642e66c5-0826-4b33-96a7-4c0e15d86022/file', 'properties': {}}, 'image_service': } Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Trying to clone 8692d62c-9a86-4f62-a760-b05c26f02f92 from image 642e66c5-0826-4b33-96a7-4c0e15d86022 at location (None, [{'url': 'file:///opt/stack/data/glance/images/642e66c5-0826-4b33-96a7-4c0e15d86022', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 1073741824" returned: 0 in 0.623s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:43 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:43 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 Nov 05 15:07:43 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:44 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e4fbf7-f188-4733-9f42-bdf84a2fca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb3139d-a925-423a-bc27-2bd6b370da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Volume volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 (8ef0e445-7e1b-4b1f-a6d0-3838fdc33944): created successfully Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb3139d-a925-423a-bc27-2bd6b370da35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Flow 'volume_create_manager' (01eac092-0542-4742-938b-6ee0b3df2729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ab817e5-0455-4164-9fe6-7010571b711b tempest-SnapshotMetadataTestJSON-1039166701 None] Created volume successfully. Nov 05 15:07:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Creating offline snapshot 37619bb2-da5a-4472-a6eb-88beea185a59 of volume 8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:07:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5814dff0-0ea0-4083-a6a2-8cf4bcee9be7]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:45 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 Nov 05 15:07:45 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:46 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" returned: 0 in 0.567s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:46 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 1G Nov 05 15:07:46 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:46 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 1G" returned: 0 in 0.669s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:47 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 Nov 05 15:07:47 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:47 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:47 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 is being set with open permissions: ugo+rw Nov 05 15:07:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:47 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 Nov 05 15:07:47 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:47 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59" returned: 0 in 0.325s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:47 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info Nov 05 15:07:47 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD, size 20.69 MB, duration 4.53 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:07:48 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Image download 20.69 MB at 4.56 MB/s Nov 05 15:07:48 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info is being set with open permissions: ugo+rw Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:48 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info Nov 05 15:07:48 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c14c90-9327-42ec-84e0-01497df3142f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:48 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD Nov 05 15:07:48 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:48 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.info" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-62bd25f6-5abf-4d6b-95a3-9cc1646e55e3 tempest-SnapshotMetadataTestJSON-1039166701 None] Create snapshot completed successfully Nov 05 15:07:48 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Temporary image 642e66c5-0826-4b33-96a7-4c0e15d86022 is fetched for user dada7af0111a44ee82c3a6afbd13e5db. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e46043-6280-4b8a-8b3d-323dd34f73b8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:48 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD Nov 05 15:07:48 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:49 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-862754865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8692d62c-9a86-4f62-a760-b05c26f02f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3129c7780d57422ba42c4cc8fed6f0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:07:43Z,use_quota=True,user_id='dada7af0111a44ee82c3a6afbd13e5db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9172355a-e05c-4045-b04c-2c567da38ea1),volume_type_id=9172355a-e05c-4045-b04c-2c567da38ea1)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Creating volume 8692d62c-9a86-4f62-a760-b05c26f02f92 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:07:49 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:49 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 1073741824 Nov 05 15:07:49 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:49 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 1073741824" returned: 0 in 0.662s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:49 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 Nov 05 15:07:49 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:50 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Attempting download of 642e66c5-0826-4b33-96a7-4c0e15d86022 ((None, [{'url': 'file:///opt/stack/data/glance/images/642e66c5-0826-4b33-96a7-4c0e15d86022', 'metadata': {}}])) to volume 8692d62c-9a86-4f62-a760-b05c26f02f92. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "cinder-37619bb2-da5a-4472-a6eb-88beea185a59-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-37619bb2-da5a-4472-a6eb-88beea185a59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "cinder-quobyte-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-quobyte-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "cinder-quobyte-37619bb2-da5a-4472-a6eb-88beea185a59" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2024e877-ef7a-41af-9758-da7575e95cd4]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-quobyte-37619bb2-da5a-4472-a6eb-88beea185a59" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Deleting offline snapshot 37619bb2-da5a-4472-a6eb-88beea185a59 of volume 8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] snapshot_file for this snap is: volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[737e0d6b-a7b2-4966-aa5e-33f18c41d098]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:50 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z Nov 05 15:07:50 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:50 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 Nov 05 15:07:50 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:50 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z" returned: 0 in 0.421s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:50 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59" returned: 0 in 0.437s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:07:50 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z Nov 05 15:07:50 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8857731b-4bb6-4949-b369-ea5c5c910f86]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:51 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 Nov 05 15:07:51 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:51 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z" returned: 1 in 0.491s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_642e66c5-0826-4b33-96a7-4c0e15d86022_ri76b29z' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60e22f4-edce-4f90-a220-7dff981901f8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:51 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" returned: 0 in 0.472s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:51 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 Nov 05 15:07:51 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:51 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD Nov 05 15:07:51 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:51 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] 642e66c5-0826-4b33-96a7-4c0e15d86022 was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:51 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 Nov 05 15:07:51 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:51 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59" returned: 0 in 0.414s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:51 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59 Nov 05 15:07:51 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:52 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944.37619bb2-da5a-4472-a6eb-88beea185a59" returned: 0 in 0.434s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-quobyte-37619bb2-da5a-4472-a6eb-88beea185a59" released by "_delete_snapshot" :: held 1.950s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-quobyte-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" released by "delete_snapshot" :: held 2.003s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Created reservations ['f1ea99d0-1274-47d9-9be6-d212afb0bccb', '2c6605c0-b245-44d3-8808-81e8379e26a5', 'b02c78c0-5819-4cef-ac65-0ba37b060a60', '1a358301-b89b-49a0-8620-d2560754c561'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Delete snapshot completed successfully. Nov 05 15:07:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2e96be1e-0b95-42f7-9e13-2042c7eabec2 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-37619bb2-da5a-4472-a6eb-88beea185a59-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "cinder-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "cinder-quobyte-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:07:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-quobyte-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:07:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7d5f07-00df-4108-a780-c2d182f4b61c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:07:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:53 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 Nov 05 15:07:53 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:54 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" returned: 0 in 0.553s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:54 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92" returned: 0 in 2.670s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_642e66c5-0826-4b33-96a7-4c0e15d86022_t2jtuo2cdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:07:54 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Converted 112.00 MB image at 41.93 MB/s Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:54 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944 Nov 05 15:07:54 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:54 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 1G Nov 05 15:07:54 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:54 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" returned: 0 in 0.400s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-quobyte-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944" released by "delete_volume" :: held 1.061s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Created reservations ['98c040e8-f2cb-4430-9478-81de08dc284e', '5e40fc63-5473-46e9-b282-58b7d497d612', 'a3a9f390-4332-4ade-b42c-ab4e087b0daa', '96f1668f-3386-4948-b1c3-c06e1aacecf2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:07:54 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 1G" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Downloaded image 642e66c5-0826-4b33-96a7-4c0e15d86022 ((None, [{'url': 'file:///opt/stack/data/glance/images/642e66c5-0826-4b33-96a7-4c0e15d86022', 'metadata': {}}])) to volume 8692d62c-9a86-4f62-a760-b05c26f02f92 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Temporary image 642e66c5-0826-4b33-96a7-4c0e15d86022 for user dada7af0111a44ee82c3a6afbd13e5db is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Marking volume 8692d62c-9a86-4f62-a760-b05c26f02f92 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Copying metadata from image 642e66c5-0826-4b33-96a7-4c0e15d86022 to 8692d62c-9a86-4f62-a760-b05c26f02f92. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Creating volume glance metadata for volume 8692d62c-9a86-4f62-a760-b05c26f02f92 backed by image 642e66c5-0826-4b33-96a7-4c0e15d86022 with: {'image_id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'image_name': 'tempest-scenario-img--509261430', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:07:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:07:55 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:07:55 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754b2c7d-bb9d-43d5-ab3c-ebe67dff97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8692d62c-9a86-4f62-a760-b05c26f02f92', 'volume_size': 1, 'image_id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/642e66c5-0826-4b33-96a7-4c0e15d86022', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--509261430', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3129c7780d57422ba42c4cc8fed6f0fc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '642e66c5-0826-4b33-96a7-4c0e15d86022', 'created_at': datetime.datetime(2026, 11, 5, 14, 7, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 7, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/642e66c5-0826-4b33-96a7-4c0e15d86022/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7a1f2c-29bd-422d-b049-26adea474d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:07:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Volume volume-8692d62c-9a86-4f62-a760-b05c26f02f92 (8692d62c-9a86-4f62-a760-b05c26f02f92): created successfully Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7a1f2c-29bd-422d-b049-26adea474d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Flow 'volume_create_manager' (b4ac471a-d68a-4145-965f-820b02ec72a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:07:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a29874ab-4b2f-4d42-a410-43f5120a95db tempest-TestInstancesWithCinderVolumes-1985274593 None] Created volume successfully. Nov 05 15:07:55 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:07:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Deleted volume successfully. Nov 05 15:07:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c958be92-45b5-44b0-85bd-86e963c83699 tempest-SnapshotMetadataTestJSON-1039166701 None] Lock "cinder-8ef0e445-7e1b-4b1f-a6d0-3838fdc33944-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Flow 'volume_create_manager' (301f0a0e-20bb-44be-b3e2-1a59be69b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01643132-a66a-4f58-b7ad-fc7c5159afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01643132-a66a-4f58-b7ad-fc7c5159afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710025501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be14df1c-0628-439a-9e7d-d6f4ce820b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92802db3a5a54829ad7df8729e87ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:01Z,use_quota=True,user_id='f61e2102a1f44e73aa3cb0500ca3b763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636d2034-efcd-4e32-831a-7a856cf6c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636d2034-efcd-4e32-831a-7a856cf6c56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67dd15-fb40-420a-96d3-eedf2d348355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f67dd15-fb40-420a-96d3-eedf2d348355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be14df1c-0628-439a-9e7d-d6f4ce820b23', 'volume_name': 'volume-be14df1c-0628-439a-9e7d-d6f4ce820b23', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342c51b3-057b-4f90-9cbc-e9b5bf0c54a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342c51b3-057b-4f90-9cbc-e9b5bf0c54a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868445fd-aa83-433f-a112-b60d81548aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Volume be14df1c-0628-439a-9e7d-d6f4ce820b23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be14df1c-0628-439a-9e7d-d6f4ce820b23', 'volume_size': 1} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-710025501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be14df1c-0628-439a-9e7d-d6f4ce820b23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92802db3a5a54829ad7df8729e87ea23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:01Z,use_quota=True,user_id='f61e2102a1f44e73aa3cb0500ca3b763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Creating volume be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:08:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:08:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:01 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 1073741824 Nov 05 15:08:01 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:02 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 1073741824" returned: 0 in 0.820s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:02 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:08:02 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:02 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.526s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (868445fd-aa83-433f-a112-b60d81548aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be14df1c-0628-439a-9e7d-d6f4ce820b23', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38ca37-ddb7-4759-8675-c672e2b2e6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Volume volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 (be14df1c-0628-439a-9e7d-d6f4ce820b23): created successfully Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be38ca37-ddb7-4759-8675-c672e2b2e6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Flow 'volume_create_manager' (301f0a0e-20bb-44be-b3e2-1a59be69b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d767359d-9d4e-4ba2-b432-138904e1ff26 tempest-VolumesActionsTest-428064367 None] Created volume successfully. Nov 05 15:08:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4563ce25-1001-41f4-b890-2f16e93aab4a req-65293d74-a46b-4f38-9265-027182106264 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4563ce25-1001-41f4-b890-2f16e93aab4a req-65293d74-a46b-4f38-9265-027182106264 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4563ce25-1001-41f4-b890-2f16e93aab4a req-65293d74-a46b-4f38-9265-027182106264 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-4563ce25-1001-41f4-b890-2f16e93aab4a req-65293d74-a46b-4f38-9265-027182106264 tempest-TestInstancesWithCinderVolumes-1985274593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-8692d62c-9a86-4f62-a760-b05c26f02f92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '593c1cc9-e333-4113-823e-51c8281aaa69', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:08:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-4563ce25-1001-41f4-b890-2f16e93aab4a req-65293d74-a46b-4f38-9265-027182106264 tempest-TestInstancesWithCinderVolumes-1985274593 None] attachment_update completed successfully. Nov 05 15:08:05 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=110,cinder:UPDATE=132,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:08:05 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=94,cinder:INSERT=40,cinder:UPDATE=136,cinder:DELETE=13 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:08:05 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Flow 'volume_create_manager' (f17fcc0c-01fd-4e54-9f67-864fcc6db685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515d3e5-5812-4c64-8052-0d38251c728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d515d3e5-5812-4c64-8052-0d38251c728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-92882745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbf1d93-a891-4cc0-85dc-e980ff29d4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceef8635d3d401c98bcab255c6f87d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:06Z,use_quota=True,user_id='0334544a6a8347bdaa96c5ef6748ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2f9997-b521-4b3c-945e-f6c66f8088b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2f9997-b521-4b3c-945e-f6c66f8088b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c443c6cd-0a51-43ca-8e51-080e4af24f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c443c6cd-0a51-43ca-8e51-080e4af24f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfbf1d93-a891-4cc0-85dc-e980ff29d4e7', 'volume_name': 'volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835ead7f-fbe1-4162-9348-c993ae646866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (835ead7f-fbe1-4162-9348-c993ae646866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd2659f-baa3-4b8c-a7bf-256c5c58ab8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Volume dfbf1d93-a891-4cc0-85dc-e980ff29d4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7', 'volume_size': 1} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-92882745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbf1d93-a891-4cc0-85dc-e980ff29d4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceef8635d3d401c98bcab255c6f87d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:06Z,use_quota=True,user_id='0334544a6a8347bdaa96c5ef6748ea19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Creating volume dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:08:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:06 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 1073741824 Nov 05 15:08:06 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:06 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 1073741824" returned: 0 in 0.807s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:07 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 Nov 05 15:08:07 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:07 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7" returned: 0 in 0.600s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cd2659f-baa3-4b8c-a7bf-256c5c58ab8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb45837-9731-4ae3-a6db-4d7ef0ff9910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Volume volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 (dfbf1d93-a891-4cc0-85dc-e980ff29d4e7): created successfully Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb45837-9731-4ae3-a6db-4d7ef0ff9910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Flow 'volume_create_manager' (f17fcc0c-01fd-4e54-9f67-864fcc6db685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-61b69000-f89f-4a35-b9fa-a2fbe6ed5114 tempest-AbsoluteLimitsTests-1013573071 None] Created volume successfully. Nov 05 15:08:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Acquiring lock "cinder-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Lock "cinder-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Acquiring lock "cinder-quobyte-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Lock "cinder-quobyte-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7" acquired by "delete_volume" :: waited 0.053s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7a921e-8eee-4911-abe1-f41e8fc516c7]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:09 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 Nov 05 15:08:09 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:09 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7" returned: 0 in 0.614s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:09 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7 Nov 05 15:08:09 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:09 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7" returned: 0 in 0.476s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Lock "cinder-quobyte-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7" released by "delete_volume" :: held 1.189s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Created reservations ['dfbb3203-63cf-43bc-8d3e-345bc9943d5f', '29c965e2-7e04-4f93-bea5-a48200182859', 'ecb7126e-ffb5-4cb7-ba46-39edb4f41dec', '9046598b-4d06-4004-a04d-60d203c45b82'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:10 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:08:10 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:11 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:11 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:08:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Deleted volume successfully. Nov 05 15:08:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-19f4020b-cbaf-48d3-ab14-358a27290f11 tempest-AbsoluteLimitsTests-1013573071 None] Lock "cinder-dfbf1d93-a891-4cc0-85dc-e980ff29d4e7-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:21 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:08:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0cfab81e-56cb-4f06-bd1a-35176ac023dd tempest-VolumesActionsTest-428064367 None] Acquiring lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23" by "attach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0cfab81e-56cb-4f06-bd1a-35176ac023dd tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23" acquired by "attach_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0cfab81e-56cb-4f06-bd1a-35176ac023dd tempest-VolumesActionsTest-428064367 None] Attaching volume be14df1c-0628-439a-9e7d-d6f4ce820b23 to instance e0c05643-d7bf-4148-9c61-f9b7b19fc9db at mountpoint /dev/vdb on host None. Nov 05 15:08:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0cfab81e-56cb-4f06-bd1a-35176ac023dd tempest-VolumesActionsTest-428064367 None] Attach volume completed successfully. Nov 05 15:08:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0cfab81e-56cb-4f06-bd1a-35176ac023dd tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23" released by "attach_volume" :: held 0.147s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0edd5878-af83-478c-a2bb-076c2989320b tempest-VolumesActionsTest-428064367 None] Acquiring lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0edd5878-af83-478c-a2bb-076c2989320b tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0edd5878-af83-478c-a2bb-076c2989320b tempest-VolumesActionsTest-428064367 None] Detaching volume be14df1c-0628-439a-9e7d-d6f4ce820b23 from instance e0c05643-d7bf-4148-9c61-f9b7b19fc9db. Nov 05 15:08:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0edd5878-af83-478c-a2bb-076c2989320b tempest-VolumesActionsTest-428064367 None] Detach volume completed successfully. Nov 05 15:08:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0edd5878-af83-478c-a2bb-076c2989320b tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Flow 'volume_create_manager' (a37b7377-a8ce-49b7-ba83-4926a242b2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e60b9d-7eae-4776-aaf5-23b4067f2408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e60b9d-7eae-4776-aaf5-23b4067f2408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1026185279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66cb3cf-ca12-4cff-9514-b43925e04fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e31a5b1db8e414b823629d115d9297e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:27Z,use_quota=True,user_id='245a28ebb3ba4e91b747e75ac873811f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3d4552-5cc7-4694-a2f0-a4f34e05063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3d4552-5cc7-4694-a2f0-a4f34e05063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25d6a99-e986-4131-80be-c329c3be5338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25d6a99-e986-4131-80be-c329c3be5338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66cb3cf-ca12-4cff-9514-b43925e04fff', 'volume_name': 'volume-a66cb3cf-ca12-4cff-9514-b43925e04fff', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a27df3-20ee-44b1-a167-4f8205956701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a27df3-20ee-44b1-a167-4f8205956701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6df5488-ef95-475c-a2fa-76dae6f51b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Volume a66cb3cf-ca12-4cff-9514-b43925e04fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66cb3cf-ca12-4cff-9514-b43925e04fff', 'volume_size': 1} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1026185279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66cb3cf-ca12-4cff-9514-b43925e04fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e31a5b1db8e414b823629d115d9297e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:27Z,use_quota=True,user_id='245a28ebb3ba4e91b747e75ac873811f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Creating volume a66cb3cf-ca12-4cff-9514-b43925e04fff {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:08:27 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:08:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:27 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff 1073741824 Nov 05 15:08:27 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:28 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff 1073741824" returned: 0 in 1.036s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:28 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff Nov 05 15:08:28 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:29 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff" returned: 0 in 0.589s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6df5488-ef95-475c-a2fa-76dae6f51b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66cb3cf-ca12-4cff-9514-b43925e04fff', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c9a182-44fc-41a2-93fd-96130c7b9179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Volume volume-a66cb3cf-ca12-4cff-9514-b43925e04fff (a66cb3cf-ca12-4cff-9514-b43925e04fff): created successfully Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c9a182-44fc-41a2-93fd-96130c7b9179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Flow 'volume_create_manager' (a37b7377-a8ce-49b7-ba83-4926a242b2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b1a2b64d-6501-4665-a4d1-cc386a195eb9 tempest-VolumesMetadataTest-878589073 None] Created volume successfully. Nov 05 15:08:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Acquiring lock "cinder-a66cb3cf-ca12-4cff-9514-b43925e04fff-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Lock "cinder-a66cb3cf-ca12-4cff-9514-b43925e04fff-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Acquiring lock "cinder-quobyte-a66cb3cf-ca12-4cff-9514-b43925e04fff" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Lock "cinder-quobyte-a66cb3cf-ca12-4cff-9514-b43925e04fff" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e4f5e-f165-482f-9a3f-957eeecd16ac]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:32 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff Nov 05 15:08:32 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:33 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff" returned: 0 in 0.937s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:33 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff Nov 05 15:08:33 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:33 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a66cb3cf-ca12-4cff-9514-b43925e04fff" returned: 0 in 0.571s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Lock "cinder-quobyte-a66cb3cf-ca12-4cff-9514-b43925e04fff" released by "delete_volume" :: held 1.598s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Created reservations ['662c62a2-7cd0-4b7e-b10c-9c48efd71ec1', 'a22f0fad-ab49-480b-ba9a-68151a59dbcb', 'd85b82eb-5d09-4448-a22f-980c7c85cd11', 'c0cb40cd-a52d-47f7-b1f4-ce679c861f4f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:34 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:08:34 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:34 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.880s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:34 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:08:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Deleted volume successfully. Nov 05 15:08:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cf0e51ec-c655-4c8a-9228-f8fb5c622670 tempest-VolumesMetadataTest-878589073 None] Lock "cinder-a66cb3cf-ca12-4cff-9514-b43925e04fff-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:39 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:08:39 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:39 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.734s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:08:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:08:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-44e5d1b9-2169-45b4-86bd-dc88bec19fd3 tempest-VolumesActionsTest-428064367 None] Acquiring lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23" by "attach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-44e5d1b9-2169-45b4-86bd-dc88bec19fd3 tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23" acquired by "attach_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-44e5d1b9-2169-45b4-86bd-dc88bec19fd3 tempest-VolumesActionsTest-428064367 None] Attaching volume be14df1c-0628-439a-9e7d-d6f4ce820b23 to instance 76d51ec5-e822-4253-8b65-03663d794071 at mountpoint /dev/vdb on host None. Nov 05 15:08:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-44e5d1b9-2169-45b4-86bd-dc88bec19fd3 tempest-VolumesActionsTest-428064367 None] Attach volume completed successfully. Nov 05 15:08:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-44e5d1b9-2169-45b4-86bd-dc88bec19fd3 tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23" released by "attach_volume" :: held 0.120s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-108ef717-27c4-4778-aa57-812e770c5f60 tempest-VolumesActionsTest-428064367 None] Acquiring lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-detach_volume" by "detach_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-108ef717-27c4-4778-aa57-812e770c5f60 tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-108ef717-27c4-4778-aa57-812e770c5f60 tempest-VolumesActionsTest-428064367 None] Detaching volume be14df1c-0628-439a-9e7d-d6f4ce820b23 from instance 76d51ec5-e822-4253-8b65-03663d794071. Nov 05 15:08:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-108ef717-27c4-4778-aa57-812e770c5f60 tempest-VolumesActionsTest-428064367 None] Detach volume completed successfully. Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-108ef717-27c4-4778-aa57-812e770c5f60 tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Flow 'volume_create_manager' (895e1c35-1db2-4a5d-954a-23ec239a8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b283d931-95d2-4072-b296-ae3831d260c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b283d931-95d2-4072-b296-ae3831d260c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2096726803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4847f513-0fb8-4b75-ad8a-c6f68d6686ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e84ab6127d244a79c560fa3cc3d0f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:44Z,use_quota=True,user_id='15fa79214f05421a96f843f43ab8d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c675a666-96d7-4041-8bd3-a359b6dfac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c675a666-96d7-4041-8bd3-a359b6dfac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070311a4-884e-40e9-8f91-c96c90dc3c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070311a4-884e-40e9-8f91-c96c90dc3c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4847f513-0fb8-4b75-ad8a-c6f68d6686ae', 'volume_name': 'volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921bdf56-1edf-435b-8a03-c8f0173fa1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (921bdf56-1edf-435b-8a03-c8f0173fa1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726a6e02-4b45-4575-807a-b0d6debc830a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Volume 4847f513-0fb8-4b75-ad8a-c6f68d6686ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae', 'volume_size': 1} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2096726803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4847f513-0fb8-4b75-ad8a-c6f68d6686ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e84ab6127d244a79c560fa3cc3d0f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:44Z,use_quota=True,user_id='15fa79214f05421a96f843f43ab8d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Creating volume 4847f513-0fb8-4b75-ad8a-c6f68d6686ae {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:08:44 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:08:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:44 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae 1073741824 Nov 05 15:08:44 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Flow 'volume_create_manager' (0d4b5323-f4d7-43c2-98a3-3b97342036ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394c75f9-5e50-46b2-b0f7-f0232e390721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394c75f9-5e50-46b2-b0f7-f0232e390721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-396903006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b542dcd09449d9660c1e63b6624fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:45Z,use_quota=True,user_id='edd0168c6643437f9a7bc46306b05db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65232c09-3634-40b5-9ad0-e1b90552af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65232c09-3634-40b5-9ad0-e1b90552af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41e43c2-5b22-48e0-bc77-d821aad8c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41e43c2-5b22-48e0-bc77-d821aad8c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0', 'volume_name': 'volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cf0f65-768a-49e5-a90b-7337a00ed71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33cf0f65-768a-49e5-a90b-7337a00ed71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66ba6c1-bfe4-4411-ace7-85d68296d4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Volume 4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0', 'volume_size': 1} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:45 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae 1073741824" returned: 0 in 0.825s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:45 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae Nov 05 15:08:45 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:46 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae" returned: 0 in 0.411s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-396903006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b542dcd09449d9660c1e63b6624fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:45Z,use_quota=True,user_id='edd0168c6643437f9a7bc46306b05db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Creating volume 4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:08:46 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726a6e02-4b45-4575-807a-b0d6debc830a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:46 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 1073741824 Nov 05 15:08:46 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ea8fa2-2034-41d8-a7d9-a7bb77fa8d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:46 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Volume volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae (4847f513-0fb8-4b75-ad8a-c6f68d6686ae): created successfully Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ea8fa2-2034-41d8-a7d9-a7bb77fa8d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Flow 'volume_create_manager' (895e1c35-1db2-4a5d-954a-23ec239a8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fca0c085-6580-4182-b558-1a3e05ea8ef0 tempest-ServersNegativeTestJSON-262854768 None] Created volume successfully. Nov 05 15:08:46 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 1073741824" returned: 0 in 0.767s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:46 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 Nov 05 15:08:46 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:47 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66ba6c1-bfe4-4411-ace7-85d68296d4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9e5a3f-f95c-4f3b-999a-1c93806b7904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Volume volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 (4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0): created successfully Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9e5a3f-f95c-4f3b-999a-1c93806b7904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Flow 'volume_create_manager' (0d4b5323-f4d7-43c2-98a3-3b97342036ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6f3b6811-20ae-437b-9037-00d76434ec8d tempest-VolumesTransfersTest-1522369656 None] Created volume successfully. Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Flow 'volume_create_manager' (85ecdafe-0147-4e42-a90c-1c2a09bbcff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44db0d15-d707-43c7-87a6-5d87bb346a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44db0d15-d707-43c7-87a6-5d87bb346a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-385305587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7817cc-5dce-4011-8311-331114cc23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e84ab6127d244a79c560fa3cc3d0f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:48Z,use_quota=True,user_id='15fa79214f05421a96f843f43ab8d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c215803-62a3-4521-8293-2545f3fbc22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c215803-62a3-4521-8293-2545f3fbc22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b3f0e-0854-41f9-82c3-43a6ffa55c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b3f0e-0854-41f9-82c3-43a6ffa55c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7817cc-5dce-4011-8311-331114cc23a7', 'volume_name': 'volume-6b7817cc-5dce-4011-8311-331114cc23a7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75193019-ee1e-4ba2-9815-7d65e1ddfcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75193019-ee1e-4ba2-9815-7d65e1ddfcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63107325-4916-4437-b70e-9b407bc8975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Volume 6b7817cc-5dce-4011-8311-331114cc23a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7817cc-5dce-4011-8311-331114cc23a7', 'volume_size': 1} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-385305587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7817cc-5dce-4011-8311-331114cc23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e84ab6127d244a79c560fa3cc3d0f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:48Z,use_quota=True,user_id='15fa79214f05421a96f843f43ab8d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Creating volume 6b7817cc-5dce-4011-8311-331114cc23a7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:08:48 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:08:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:48 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 1073741824 Nov 05 15:08:48 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:49 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 1073741824" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:49 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 Nov 05 15:08:49 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:49 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63107325-4916-4437-b70e-9b407bc8975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7817cc-5dce-4011-8311-331114cc23a7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22aaa02f-1981-410e-a79d-0c6d44ffeb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Volume volume-6b7817cc-5dce-4011-8311-331114cc23a7 (6b7817cc-5dce-4011-8311-331114cc23a7): created successfully Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22aaa02f-1981-410e-a79d-0c6d44ffeb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Flow 'volume_create_manager' (85ecdafe-0147-4e42-a90c-1c2a09bbcff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d90533cd-d410-4b57-a0a7-7b3ddc6b973f tempest-VolumesTransfersTest-1799195729 None] Transfer volume completed successfully. Nov 05 15:08:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ed0e08b7-fe10-4266-bb36-615f8c0421b3 tempest-ServersNegativeTestJSON-262854768 None] Created volume successfully. Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2343b60-22a6-41d2-9d3a-722e01137085]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:49 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:08:49 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-de08af65-79f4-43c4-9e5c-d56cefd643f4 req-21b5d760-8205-47a0-a9e6-8bf2fcb5b0ac tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Acquiring lock "cinder-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:50 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.478s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Acquiring lock "cinder-quobyte-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a3714-778e-448d-916a-b080f696bcbc]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "cinder-6b7817cc-5dce-4011-8311-331114cc23a7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-quobyte-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-6b7817cc-5dce-4011-8311-331114cc23a7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ba1d22-073f-4d7e-a52b-738fc8ecb33a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "cinder-quobyte-6b7817cc-5dce-4011-8311-331114cc23a7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-quobyte-6b7817cc-5dce-4011-8311-331114cc23a7" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:50 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:08:50 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21bacb3-ffea-4a42-b066-eb64c59be79d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:50 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 Nov 05 15:08:50 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 Nov 05 15:08:50 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.534d6256-006a-44ed-8eeb-c818b976b6cdnpp9ch9b.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:50 devstack sudo[96116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.534d6256-006a-44ed-8eeb-c818b976b6cdnpp9ch9b.img Nov 05 15:08:50 devstack sudo[96116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:50 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0 Nov 05 15:08:50 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7" returned: 0 in 0.437s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:50 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7 Nov 05 15:08:50 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:50 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-quobyte-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0" released by "delete_volume" :: held 0.831s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:51 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b7817cc-5dce-4011-8311-331114cc23a7" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-quobyte-6b7817cc-5dce-4011-8311-331114cc23a7" released by "delete_volume" :: held 0.866s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Created reservations ['5abe89b5-b3d7-4846-bdcb-c7726e8f6f7e', '8f7a7769-3de7-4af2-8dec-61b5a57c67fe', '29a9c996-342b-4b40-b734-7d20bf91b6e2', '2e24c0fb-7b2c-4751-9070-aa6447648e19'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Created reservations ['500250d5-4281-40ce-a282-b99490de6958', '8b838a69-6d0f-4ceb-92f2-7b0d1c9e770e', 'd9f27021-ed75-467e-b740-6722b27e9a8e', '18bd2280-2b6a-4f32-bf2f-ef4549e9a935'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:51 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:08:51 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:51 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:08:51 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:08:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Deleted volume successfully. Nov 05 15:08:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7ff000-f0a2-4c25-beae-d210c3ec9014 tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-4fbf88c6-f658-4dd9-a3ed-498ed4d7eea0-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:52 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.567s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:08:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Deleted volume successfully. Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-46d9af79-793e-4c90-94c0-d0eebebaf58a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-6b7817cc-5dce-4011-8311-331114cc23a7-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "cinder-4847f513-0fb8-4b75-ad8a-c6f68d6686ae-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Flow 'volume_create_manager' (1dc45570-e94f-4142-8b1e-e14712721c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d83325-30f3-43b8-9f3e-ca47756910ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-4847f513-0fb8-4b75-ad8a-c6f68d6686ae-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d83325-30f3-43b8-9f3e-ca47756910ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-878001507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56de3b02-d383-4ced-9875-44fb641e4334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b542dcd09449d9660c1e63b6624fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:53Z,use_quota=True,user_id='edd0168c6643437f9a7bc46306b05db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85fabe3-423b-459a-9b96-cfb60ef5d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85fabe3-423b-459a-9b96-cfb60ef5d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac94480-5a75-4a9a-a30f-55d0e8a12e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac94480-5a75-4a9a-a30f-55d0e8a12e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56de3b02-d383-4ced-9875-44fb641e4334', 'volume_name': 'volume-56de3b02-d383-4ced-9875-44fb641e4334', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad9aea3-6151-406e-9ad2-c05667b4e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad9aea3-6151-406e-9ad2-c05667b4e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e78c5f-b5b1-4de9-94bf-2e89505bbbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:08:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Volume 56de3b02-d383-4ced-9875-44fb641e4334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56de3b02-d383-4ced-9875-44fb641e4334', 'volume_size': 1} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "cinder-quobyte-4847f513-0fb8-4b75-ad8a-c6f68d6686ae" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:08:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-quobyte-4847f513-0fb8-4b75-ad8a-c6f68d6686ae" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:08:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[661fbba9-95fb-4dbb-b7e3-4f163344c9d2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:53 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae Nov 05 15:08:53 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:53 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae" returned: 0 in 0.562s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:53 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae Nov 05 15:08:53 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:53 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4847f513-0fb8-4b75-ad8a-c6f68d6686ae" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-quobyte-4847f513-0fb8-4b75-ad8a-c6f68d6686ae" released by "delete_volume" :: held 1.018s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Created reservations ['3b6a8baa-c13f-484d-bf8b-f78d70d65962', 'ab3ec2d5-b196-4280-8abf-3b8a7f9e23ed', '303a33b7-10f9-47b5-9f22-739a8d680ad5', '844b703f-b646-41c1-b1dc-018257e636f7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:54 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:08:54 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:54 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:08:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Deleted volume successfully. Nov 05 15:08:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a5ddf694-5177-443e-a97a-bfe4654f0f9a tempest-ServersNegativeTestJSON-262854768 None] Lock "cinder-4847f513-0fb8-4b75-ad8a-c6f68d6686ae-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:08:58 devstack sudo[96116]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.534d6256-006a-44ed-8eeb-c818b976b6cdnpp9ch9b.img" returned: 0 in 7.723s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed297aa0-dd93-43c7-92dd-c075503d6e0b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:08:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:08:58 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:08:58 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:08:58 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Nov 05 15:08:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.545s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:08:58 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23, size 1024.00 MB, duration 7.72 sec, destination /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.534d6256-006a-44ed-8eeb-c818b976b6cdnpp9ch9b.img {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:08:58 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Converted 1024.00 MB image at 132.58 MB/s Nov 05 15:08:58 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] 534d6256-006a-44ed-8eeb-c818b976b6cd was raw, no need to convert to raw {{(pid=87126) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 15:09:08 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=44,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:09:08 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=56,cinder:INSERT=15,cinder:UPDATE=56,cinder:DELETE=5 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.371s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Uploaded volume to glance image-id: 534d6256-006a-44ed-8eeb-c818b976b6cd. {{(pid=87126) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-de08af65-79f4-43c4-9e5c-d56cefd643f4 req-21b5d760-8205-47a0-a9e6-8bf2fcb5b0ac tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 29.945s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-de08af65-79f4-43c4-9e5c-d56cefd643f4 req-21b5d760-8205-47a0-a9e6-8bf2fcb5b0ac tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.146s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-878001507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56de3b02-d383-4ced-9875-44fb641e4334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b542dcd09449d9660c1e63b6624fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:08:53Z,use_quota=True,user_id='edd0168c6643437f9a7bc46306b05db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Creating volume 56de3b02-d383-4ced-9875-44fb641e4334 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:09:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1bdb5970-8112-48d4-9c05-b68b8d1402b7 tempest-VolumesActionsTest-428064367 None] Copy volume to image completed successfully. Nov 05 15:09:20 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 1073741824 Nov 05 15:09:20 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-de08af65-79f4-43c4-9e5c-d56cefd643f4 req-21b5d760-8205-47a0-a9e6-8bf2fcb5b0ac tempest-TestInstancesWithCinderVolumes-1985274593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '003fa73a-cf84-4cd3-b305-dd62ae47cddc', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:09:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-de08af65-79f4-43c4-9e5c-d56cefd643f4 req-21b5d760-8205-47a0-a9e6-8bf2fcb5b0ac tempest-TestInstancesWithCinderVolumes-1985274593 None] attachment_update completed successfully. Nov 05 15:09:20 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 1073741824" returned: 0 in 0.533s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:20 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 Nov 05 15:09:20 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:20 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e78c5f-b5b1-4de9-94bf-2e89505bbbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56de3b02-d383-4ced-9875-44fb641e4334', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02eb7c6-cffd-46a1-86b9-fdd08462d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Volume volume-56de3b02-d383-4ced-9875-44fb641e4334 (56de3b02-d383-4ced-9875-44fb641e4334): created successfully Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02eb7c6-cffd-46a1-86b9-fdd08462d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Flow 'volume_create_manager' (1dc45570-e94f-4142-8b1e-e14712721c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3b88deb3-ef1a-4193-a92e-5f506e963bad tempest-VolumesTransfersTest-1522369656 None] Created volume successfully. Nov 05 15:09:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Acquiring lock "cinder-56de3b02-d383-4ced-9875-44fb641e4334-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-56de3b02-d383-4ced-9875-44fb641e4334-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Acquiring lock "cinder-quobyte-56de3b02-d383-4ced-9875-44fb641e4334" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-quobyte-56de3b02-d383-4ced-9875-44fb641e4334" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ad9fa4-2b64-4bca-9028-0937634bbce0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:21 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 Nov 05 15:09:21 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:22 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334" returned: 0 in 0.473s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:22 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334 Nov 05 15:09:22 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a3cf3-5e66-44c6-b73d-a174493420c6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:22 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-56de3b02-d383-4ced-9875-44fb641e4334" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-quobyte-56de3b02-d383-4ced-9875-44fb641e4334" released by "delete_volume" :: held 0.967s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:22 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:09:22 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Created reservations ['671319f1-ebb7-4b9e-96af-aee52b5898cd', '3af75ae6-2cfd-4026-8618-4ecfd883cb45', '2eb8f3c6-b696-43e4-b335-5a02721e3279', 'ac08b8c0-54e0-4a3d-b1c1-4d8e99bad35e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:22 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:22 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-d847f463-604d-4ea8-9e60-1ed14b189759 req-aa7583e7-7bd7-4700-8c3d-5063e5bd96d2 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:22 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.529s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfb65e6-ea99-4492-a34a-a32d59d63837]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:23 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:09:23 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:23 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Deleted volume successfully. Nov 05 15:09:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36ed6a31-7460-442a-87c8-da5fa2e3ff9e tempest-VolumesTransfersTest-1515923515 None] Lock "cinder-56de3b02-d383-4ced-9875-44fb641e4334-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:23 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.407s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:23 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img Nov 05 15:09:23 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:32 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:09:33 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=15,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:09:33 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img" returned: 0 in 10.019s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d27f5f-33d6-451e-a722-f107e1c9b08f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:33 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:09:33 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:34 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.619s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23, size 1024.00 MB, duration 10.02 sec, destination /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:09:34 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Converted 1024.00 MB image at 102.19 MB/s Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] 48f0cb42-f839-48fa-bf83-50df8c054b48 was raw, converting to qcow2 {{(pid=87126) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0c4ac3-20cb-4a5b-b2de-bb57d2da1e94]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:34 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img Nov 05 15:09:34 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:34 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img" returned: 0 in 0.471s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:34 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img Nov 05 15:09:34 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:35 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img" returned: 1 in 0.444s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img /opt/stack/data/cinder/conversion/vol_upload_1rpibbda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:35 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img /opt/stack/data/cinder/conversion/vol_upload_1rpibbda Nov 05 15:09:35 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:35 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img /opt/stack/data/cinder/conversion/vol_upload_1rpibbda" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Image conversion details: src /opt/stack/data/cinder/conversion/be14df1c-0628-439a-9e7d-d6f4ce820b23.temp_image.48f0cb42-f839-48fa-bf83-50df8c054b48tmcy19zd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1rpibbda {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:09:35 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79bc9ce-5cab-4966-82cb-2421639f29f4]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1rpibbda {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:35 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1rpibbda Nov 05 15:09:35 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:35 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1rpibbda" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (6968b878-9258-41dd-afcb-f8993bdb3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82359ca4-60fa-40b1-a75d-6add91c459c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82359ca4-60fa-40b1-a75d-6add91c459c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1742627178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bfb6ca-9837-4fc9-a07f-74f6648d705e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:37Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956fccec-2f40-49e6-bdea-a89243a45bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956fccec-2f40-49e6-bdea-a89243a45bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682c75ff-2958-46a9-b8ef-0c49643335a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682c75ff-2958-46a9-b8ef-0c49643335a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6bfb6ca-9837-4fc9-a07f-74f6648d705e', 'volume_name': 'volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2c8aa7-3303-4457-8557-6cf28e6ed81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2c8aa7-3303-4457-8557-6cf28e6ed81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c849caf1-19e3-49fc-8dac-b70d13baeedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Volume d6bfb6ca-9837-4fc9-a07f-74f6648d705e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e', 'volume_size': 1} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Uploaded volume to glance image-id: 48f0cb42-f839-48fa-bf83-50df8c054b48. {{(pid=87126) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-d847f463-604d-4ea8-9e60-1ed14b189759 req-aa7583e7-7bd7-4700-8c3d-5063e5bd96d2 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.528s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-d847f463-604d-4ea8-9e60-1ed14b189759 req-aa7583e7-7bd7-4700-8c3d-5063e5bd96d2 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1742627178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bfb6ca-9837-4fc9-a07f-74f6648d705e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:37Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Creating volume d6bfb6ca-9837-4fc9-a07f-74f6648d705e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:09:37 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbb2cd0b-5631-4886-b151-61e81a59d62a tempest-VolumesActionsTest-428064367 None] Copy volume to image completed successfully. Nov 05 15:09:37 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e 1073741824 Nov 05 15:09:37 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-d847f463-604d-4ea8-9e60-1ed14b189759 req-aa7583e7-7bd7-4700-8c3d-5063e5bd96d2 tempest-TestInstancesWithCinderVolumes-1985274593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35f80b43-6d0b-4c58-b676-b535938c01e9', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:09:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-d847f463-604d-4ea8-9e60-1ed14b189759 req-aa7583e7-7bd7-4700-8c3d-5063e5bd96d2 tempest-TestInstancesWithCinderVolumes-1985274593 None] attachment_update completed successfully. Nov 05 15:09:37 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e 1073741824" returned: 0 in 0.569s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:38 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e Nov 05 15:09:38 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:38 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c849caf1-19e3-49fc-8dac-b70d13baeedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6b6c98-6aef-4b18-a70d-a6416a1db67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Volume volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e (d6bfb6ca-9837-4fc9-a07f-74f6648d705e): created successfully Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6b6c98-6aef-4b18-a70d-a6416a1db67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (6968b878-9258-41dd-afcb-f8993bdb3849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-73fe3efc-4d14-47a9-bbea-9c1a05b4fb48 tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:39 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:39 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Acquiring lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Acquiring lock "cinder-quobyte-be14df1c-0628-439a-9e7d-d6f4ce820b23" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Lock "cinder-quobyte-be14df1c-0628-439a-9e7d-d6f4ce820b23" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fe281a-1df0-481b-8510-b6d3bdac37fe]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:39 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:09:39 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:09:39 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:39 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.491s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:39 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23 Nov 05 15:09:39 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:40 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be14df1c-0628-439a-9e7d-d6f4ce820b23" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Lock "cinder-quobyte-be14df1c-0628-439a-9e7d-d6f4ce820b23" released by "delete_volume" :: held 0.950s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (300ab10e-8358-4d21-a6b5-5ed48d2dc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5410fde-94af-4fc5-a520-3b6f83ea16d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5410fde-94af-4fc5-a520-3b6f83ea16d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1106415338',display_name='tempest-VolumesGetTest-Volume-831938420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69d1a76-dfec-41f2-9fc3-357202aa96b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:40Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd696af-3486-40fb-a57b-75454a429c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd696af-3486-40fb-a57b-75454a429c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54dd091-1b69-4ed2-9ef9-885d6e7a378f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c54dd091-1b69-4ed2-9ef9-885d6e7a378f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69d1a76-dfec-41f2-9fc3-357202aa96b1', 'volume_name': 'volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86eb1262-7151-4861-b0bc-b00c4069ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86eb1262-7151-4861-b0bc-b00c4069ff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad851511-c6a8-4f1b-801f-c6dd34f60306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Volume a69d1a76-dfec-41f2-9fc3-357202aa96b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1', 'volume_size': 1} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1106415338',display_name='tempest-VolumesGetTest-Volume-831938420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69d1a76-dfec-41f2-9fc3-357202aa96b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:40Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Creating volume a69d1a76-dfec-41f2-9fc3-357202aa96b1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:09:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Created reservations ['3fb46384-f954-42c0-8a5a-a4418dc66cce', '816ee1ed-8692-46b4-ad10-0d9e845236fb', '7ed01308-7271-4ccc-84ba-fb3029d0af58', 'f2b68db2-0879-4e7d-95a1-b73a8a2bd743'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:40 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 1073741824 Nov 05 15:09:40 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:40 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:40 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:40 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Deleted volume successfully. Nov 05 15:09:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ca3667b9-fde8-4154-855a-c4127c33fc97 tempest-VolumesActionsTest-428064367 None] Lock "cinder-be14df1c-0628-439a-9e7d-d6f4ce820b23-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:41 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 1073741824" returned: 0 in 0.548s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:41 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 Nov 05 15:09:41 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:41 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1" returned: 0 in 0.304s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad851511-c6a8-4f1b-801f-c6dd34f60306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dcdfe20-46f9-4016-a968-5cc5d2087990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Volume volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 (a69d1a76-dfec-41f2-9fc3-357202aa96b1): created successfully Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dcdfe20-46f9-4016-a968-5cc5d2087990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (300ab10e-8358-4d21-a6b5-5ed48d2dc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7ebce8c0-4d14-4b6f-89fd-cbe0f8b6f3bf tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:09:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-a69d1a76-dfec-41f2-9fc3-357202aa96b1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Lock "cinder-a69d1a76-dfec-41f2-9fc3-357202aa96b1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-a69d1a76-dfec-41f2-9fc3-357202aa96b1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-a69d1a76-dfec-41f2-9fc3-357202aa96b1" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd80472-e55a-4659-92a9-65205ee3b904]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:42 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 Nov 05 15:09:42 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:43 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:43 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1 Nov 05 15:09:43 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:43 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a69d1a76-dfec-41f2-9fc3-357202aa96b1" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-a69d1a76-dfec-41f2-9fc3-357202aa96b1" released by "delete_volume" :: held 0.969s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Created reservations ['bf210d9a-c579-47d9-929f-1ca5babdaa97', 'a7515044-8ac3-4a2a-be89-8d46c4d440c8', '848e860c-9b52-4cd9-9e4c-a5b84300d8e0', '54c428d5-e047-43dd-85dd-92c02aa08d77'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:43 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:43 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-1d8ecc1c-0bd6-4b63-b107-dd2cdc1e3be0 req-d5781be6-d2b0-4351-ba87-1ede8f04ae2a tempest-TestInstancesWithCinderVolumes-1985274593 None] Terminate volume connection completed successfully. Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-1d8ecc1c-0bd6-4b63-b107-dd2cdc1e3be0 req-d5781be6-d2b0-4351-ba87-1ede8f04ae2a tempest-TestInstancesWithCinderVolumes-1985274593 None] Deleting attachment 003fa73a-cf84-4cd3-b305-dd62ae47cddc. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:09:44 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.414s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fedd96fc-248f-4148-aa99-b4bca5cd0b77 tempest-VolumesGetTest-44830152 None] Lock "cinder-a69d1a76-dfec-41f2-9fc3-357202aa96b1-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "cinder-e8d4e92b-a82f-46fe-9761-1f345149e5f0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-e8d4e92b-a82f-46fe-9761-1f345149e5f0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "cinder-quobyte-e8d4e92b-a82f-46fe-9761-1f345149e5f0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-quobyte-e8d4e92b-a82f-46fe-9761-1f345149e5f0" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c0bec-f741-4236-a013-67f69fa80668]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:45 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 Nov 05 15:09:45 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-d6bfb6ca-9837-4fc9-a07f-74f6648d705e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Lock "cinder-d6bfb6ca-9837-4fc9-a07f-74f6648d705e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-d6bfb6ca-9837-4fc9-a07f-74f6648d705e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-d6bfb6ca-9837-4fc9-a07f-74f6648d705e" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac6e185-3580-4416-8974-578b1d775d64]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:45 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e Nov 05 15:09:45 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:45 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:45 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0 Nov 05 15:09:45 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:45 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e8d4e92b-a82f-46fe-9761-1f345149e5f0" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-quobyte-e8d4e92b-a82f-46fe-9761-1f345149e5f0" released by "delete_volume" :: held 0.798s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:45 devstack cinder-volume[87126]: WARNING cinder.quota [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-753927693-357957162 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-753927693-357957162, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:09:45 devstack cinder-volume[87126]: WARNING cinder.quota [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-753927693-357957162 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-753927693-357957162, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:09:45 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e" returned: 0 in 0.580s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Created reservations ['df4a2fbf-355d-4215-ae6a-1ec508714014', '2f6513eb-94d2-4548-8244-e709dde0946a', 'cc640716-74e1-42a2-a8a9-3ddb3994b1d4', 'aad76979-61de-4dac-baee-8773dbcba2c2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:45 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e Nov 05 15:09:45 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:45 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:45 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:46 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d6bfb6ca-9837-4fc9-a07f-74f6648d705e" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-d6bfb6ca-9837-4fc9-a07f-74f6648d705e" released by "delete_volume" :: held 0.932s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Created reservations ['5071d2ac-9959-4397-90ca-8c52e0dc7e50', '684a2b37-0e05-40b8-add3-0d83048f6928', '16d4d133-5a92-42a6-9ab1-4e74403f68a5', '36392c12-7617-441e-b529-b8e5529e3116'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:46 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deleted volume successfully. Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-83c2fa84-32e1-4f06-97bc-c3277260dd58 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-e8d4e92b-a82f-46fe-9761-1f345149e5f0-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:46 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:46 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:46 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:09:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-82841e92-af35-4150-b274-ae25c10896b2 tempest-VolumesGetTest-44830152 None] Lock "cinder-d6bfb6ca-9837-4fc9-a07f-74f6648d705e-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (a6fe9011-3831-4da2-870d-771f86ac815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab54df6-e798-453e-803f-c101df335346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab54df6-e798-453e-803f-c101df335346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1629928512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152fde07-2533-459a-8a83-1cf1e7820c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:48Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085969d6-1f40-40eb-9ad7-9bc3822d7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085969d6-1f40-40eb-9ad7-9bc3822d7f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce48ad0d-3860-4208-987b-ce573c70089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce48ad0d-3860-4208-987b-ce573c70089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152fde07-2533-459a-8a83-1cf1e7820c59', 'volume_name': 'volume-152fde07-2533-459a-8a83-1cf1e7820c59', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9570095b-5b46-4aee-9213-490c71e11716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9570095b-5b46-4aee-9213-490c71e11716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bf75bd-1d89-478f-a89e-2817d176f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Volume 152fde07-2533-459a-8a83-1cf1e7820c59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152fde07-2533-459a-8a83-1cf1e7820c59', 'volume_size': 1} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1629928512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152fde07-2533-459a-8a83-1cf1e7820c59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:48Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Creating volume 152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:09:47 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:09:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:48 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 1073741824 Nov 05 15:09:48 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:48 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 1073741824" returned: 0 in 0.511s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:48 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 Nov 05 15:09:48 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:48 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bf75bd-1d89-478f-a89e-2817d176f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152fde07-2533-459a-8a83-1cf1e7820c59', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d8b765-39e0-4bd6-8a94-98e8b5aefb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Volume volume-152fde07-2533-459a-8a83-1cf1e7820c59 (152fde07-2533-459a-8a83-1cf1e7820c59): created successfully Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d8b765-39e0-4bd6-8a94-98e8b5aefb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (a6fe9011-3831-4da2-870d-771f86ac815a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-762cc977-44e5-4807-8bb9-0578e83a875d tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:09:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-96575f45-d7dd-4a32-b907-d887037bc447 req-5114621d-554a-438a-aaf7-bb2f81b0d272 tempest-TestInstancesWithCinderVolumes-1985274593 None] Terminate volume connection completed successfully. Nov 05 15:09:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-96575f45-d7dd-4a32-b907-d887037bc447 req-5114621d-554a-438a-aaf7-bb2f81b0d272 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deleting attachment 35f80b43-6d0b-4c58-b676-b535938c01e9. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:09:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "cinder-30ce76c8-6a50-464a-95ae-6c4d02ef73f7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-30ce76c8-6a50-464a-95ae-6c4d02ef73f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "cinder-quobyte-30ce76c8-6a50-464a-95ae-6c4d02ef73f7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-quobyte-30ce76c8-6a50-464a-95ae-6c4d02ef73f7" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ddaa0a-0360-417b-93d8-725edde9f4fa]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:50 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 Nov 05 15:09:50 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:50 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Flow 'volume_create_manager' (dfabf0a4-d74f-4556-bff7-08c3d4d1b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa7a8f2-62a0-4518-9b7e-e41426a46a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7" returned: 0 in 0.590s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa7a8f2-62a0-4518-9b7e-e41426a46a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1510267012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06dacf8a-c121-41fc-81d2-2906e73eea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdcddce87ba4b7192482154b0609ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:50Z,use_quota=True,user_id='d6f2aaa70b184609ba3575e51a5200a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c4a677-1c68-469b-b1a7-96dd873cff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c4a677-1c68-469b-b1a7-96dd873cff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d312a90-baa2-4b5d-b5e9-3016588edb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d312a90-baa2-4b5d-b5e9-3016588edb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06dacf8a-c121-41fc-81d2-2906e73eea8e', 'volume_name': 'volume-06dacf8a-c121-41fc-81d2-2906e73eea8e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:50 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7 Nov 05 15:09:50 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2619cf-372d-4620-83d0-26d4b7656381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a2619cf-372d-4620-83d0-26d4b7656381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21ca548-de7f-4807-a626-c5955a8604d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Volume 06dacf8a-c121-41fc-81d2-2906e73eea8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06dacf8a-c121-41fc-81d2-2906e73eea8e', 'volume_size': 1} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1510267012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06dacf8a-c121-41fc-81d2-2906e73eea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdcddce87ba4b7192482154b0609ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:50Z,use_quota=True,user_id='d6f2aaa70b184609ba3575e51a5200a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Creating volume 06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:09:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:09:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:50 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e 1073741824 Nov 05 15:09:50 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:51 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30ce76c8-6a50-464a-95ae-6c4d02ef73f7" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-quobyte-30ce76c8-6a50-464a-95ae-6c4d02ef73f7" released by "delete_volume" :: held 1.071s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:51 devstack cinder-volume[87126]: WARNING cinder.quota [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234996457-1971200728 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234996457-1971200728, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:09:51 devstack cinder-volume[87126]: WARNING cinder.quota [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234996457-1971200728 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234996457-1971200728, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (eb4b5554-3e98-46ef-9c36-e526dac9d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cee9bf-c59b-4079-b6ca-4f9860c8c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cee9bf-c59b-4079-b6ca-4f9860c8c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1766587557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9e97b2-8cad-4670-b62b-75aa31fca8c6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=152fde07-2533-459a-8a83-1cf1e7820c59,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:51Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7e8f8c-c4f5-43bc-b823-f18e7af3d6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7e8f8c-c4f5-43bc-b823-f18e7af3d6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862e374b-a6e8-4bea-8946-ddcc2b2fcd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Created reservations ['12080983-759c-4bac-bbfd-a4494babd245', 'c6efb210-9983-4b91-92ea-852a5c5765d2', 'c4fcbd8e-7485-463a-91ef-6d0526843427', '27f2f790-5273-4df8-a535-57d0cf1eb5d4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862e374b-a6e8-4bea-8946-ddcc2b2fcd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fa9e97b2-8cad-4670-b62b-75aa31fca8c6', 'volume_name': 'volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6', 'volume_size': 1, 'source_volid': '152fde07-2533-459a-8a83-1cf1e7820c59', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86abfd7-817c-4f8e-a4ea-476b2c616c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86abfd7-817c-4f8e-a4ea-476b2c616c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b131ed9-eed2-4f24-bcb7-a6b8d9617bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Volume fa9e97b2-8cad-4670-b62b-75aa31fca8c6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6', 'volume_size': 1, 'source_volid': '152fde07-2533-459a-8a83-1cf1e7820c59', 'source_volstatus': 'available'} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:51 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e 1073741824" returned: 0 in 0.687s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:51 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:51 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:51 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e Nov 05 15:09:51 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:51 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.340s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deleted volume successfully. Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bd0e035a-9d28-4838-8abe-f9f56a97f998 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-30ce76c8-6a50-464a-95ae-6c4d02ef73f7-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:51 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.502s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:51 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Cloning volume 152fde07-2533-459a-8a83-1cf1e7820c59 to volume fa9e97b2-8cad-4670-b62b-75aa31fca8c6 Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f21ca548-de7f-4807-a626-c5955a8604d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06dacf8a-c121-41fc-81d2-2906e73eea8e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fbfaa-b5e7-4517-84b4-3ed4d5b8812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Creating offline snapshot d34171e1-3a0b-4fda-b426-74638518b715 of volume 152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:09:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Volume volume-06dacf8a-c121-41fc-81d2-2906e73eea8e (06dacf8a-c121-41fc-81d2-2906e73eea8e): created successfully Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6fbfaa-b5e7-4517-84b4-3ed4d5b8812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Flow 'volume_create_manager' (dfabf0a4-d74f-4556-bff7-08c3d4d1b426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d040cc87-4da3-44cf-852c-e64095bc4079]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7e58a392-69d5-4f52-acb5-aaad24b4666d tempest-VolumesCloneTest-913796194 None] Created volume successfully. Nov 05 15:09:52 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 Nov 05 15:09:52 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:52 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59" returned: 0 in 0.550s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:52 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 1G Nov 05 15:09:52 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:52 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 1G" returned: 0 in 0.505s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152fde07-2533-459a-8a83-1cf1e7820c59 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:53 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152fde07-2533-459a-8a83-1cf1e7820c59 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 Nov 05 15:09:53 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Flow 'volume_create_manager' (d6529fd2-842d-4b2c-8bc2-14a802c77184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c652d80-5f9e-4b83-8cb1-dfd205060c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:53 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-152fde07-2533-459a-8a83-1cf1e7820c59 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:53 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 is being set with open permissions: ugo+rw Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c652d80-5f9e-4b83-8cb1-dfd205060c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1150076283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe8b7cc-5d71-4478-b582-3828f2b362c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdcddce87ba4b7192482154b0609ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=06dacf8a-c121-41fc-81d2-2906e73eea8e,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:53Z,use_quota=True,user_id='d6f2aaa70b184609ba3575e51a5200a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87235abc-6599-4eb9-9913-bdbfc17b1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87235abc-6599-4eb9-9913-bdbfc17b1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:53 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 Nov 05 15:09:53 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c95185f-800a-4eae-a084-89e814ba2bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c95185f-800a-4eae-a084-89e814ba2bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'abe8b7cc-5d71-4478-b582-3828f2b362c6', 'volume_name': 'volume-abe8b7cc-5d71-4478-b582-3828f2b362c6', 'volume_size': 2, 'source_volid': '06dacf8a-c121-41fc-81d2-2906e73eea8e', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506b285f-78b8-43c8-9b99-ff4c563c3fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (506b285f-78b8-43c8-9b99-ff4c563c3fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51a6421-0795-4724-85ab-117a4d7bdb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Volume abe8b7cc-5d71-4478-b582-3828f2b362c6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-abe8b7cc-5d71-4478-b582-3828f2b362c6', 'volume_size': 2, 'source_volid': '06dacf8a-c121-41fc-81d2-2906e73eea8e', 'source_volstatus': 'available'} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:53 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:53 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info Nov 05 15:09:53 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:54 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info" returned: 0 in 0.471s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:54 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info is being set with open permissions: ugo+rw Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:54 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info Nov 05 15:09:54 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:54 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.info" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] snapshot: d34171e1-3a0b-4fda-b426-74638518b715, volume: fa9e97b2-8cad-4670-b62b-75aa31fca8c6, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4762b1df-8775-4159-9287-de0ac02fbb72]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:54 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 Nov 05 15:09:54 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:55 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152fde07-2533-459a-8a83-1cf1e7820c59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c068dfc-434c-4e33-8799-bfac41a12dc1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:55 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 Nov 05 15:09:55 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-8e3c82b9-980a-4f09-8fa4-32ebde606e66 req-23ba710d-23be-46e0-95d5-3a2e11d6d209 tempest-TestInstancesWithCinderVolumes-1985274593 None] Terminate volume connection completed successfully. Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8e3c82b9-980a-4f09-8fa4-32ebde606e66 req-23ba710d-23be-46e0-95d5-3a2e11d6d209 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deleting attachment 593c1cc9-e333-4113-823e-51c8281aaa69. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:09:55 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:09:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:55 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 Nov 05 15:09:55 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "cinder-8692d62c-9a86-4f62-a760-b05c26f02f92-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-8692d62c-9a86-4f62-a760-b05c26f02f92-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "cinder-quobyte-8692d62c-9a86-4f62-a760-b05c26f02f92" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:09:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-quobyte-8692d62c-9a86-4f62-a760-b05c26f02f92" acquired by "delete_volume" :: waited 0.049s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:09:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[518d1e63-f39f-4d2d-a0c3-d6edeeb65dee]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:09:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:57 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 Nov 05 15:09:57 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Flow 'volume_create_manager' (5cb550ba-a9f7-4ea3-8f4b-3e0eb237f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b5694f-ad3c-49df-a04e-908044135201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b5694f-ad3c-49df-a04e-908044135201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1084786565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c052378-367e-43ae-821f-2ec3ba32f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7e53fdadd249e89b5d89740dbe97c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:57Z,use_quota=True,user_id='4a62f32f7a1945cca4077c173044e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34edc834-5208-46bc-b0a1-2849228d8cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34edc834-5208-46bc-b0a1-2849228d8cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:57 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc956ac6-9ad1-4808-97e7-295b93d8131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc956ac6-9ad1-4808-97e7-295b93d8131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c052378-367e-43ae-821f-2ec3ba32f2e4', 'volume_name': 'volume-3c052378-367e-43ae-821f-2ec3ba32f2e4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8241b579-021d-4280-8d24-82938a65b6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8241b579-021d-4280-8d24-82938a65b6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d244b-61ad-45e8-8a05-2946005cfae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:09:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Volume 3c052378-367e-43ae-821f-2ec3ba32f2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c052378-367e-43ae-821f-2ec3ba32f2e4', 'volume_size': 1} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92" returned: 0 in 0.771s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:57 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92 Nov 05 15:09:57 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:58 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8692d62c-9a86-4f62-a760-b05c26f02f92" returned: 0 in 0.548s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-quobyte-8692d62c-9a86-4f62-a760-b05c26f02f92" released by "delete_volume" :: held 1.436s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:09:58 devstack cinder-volume[87126]: WARNING cinder.quota [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-821534742-1417963829 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-821534742-1417963829, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:09:58 devstack cinder-volume[87126]: WARNING cinder.quota [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-821534742-1417963829 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-821534742-1417963829, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Created reservations ['f9e26631-e4f1-49e5-b549-ec0359896b02', '0706ee43-81b2-41b9-9546-904c3ffbea3b', '5552ec40-aef0-41a7-b873-31690c8f39ab', 'c9462749-3466-4f2e-9ce7-5c89c19ea61f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:09:58 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:09:58 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:09:58 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:09:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Deleted volume successfully. Nov 05 15:09:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-75fcfc69-7633-4071-b556-0659caf01796 tempest-TestInstancesWithCinderVolumes-1985274593 None] Lock "cinder-8692d62c-9a86-4f62-a760-b05c26f02f92-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:02 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" returned: 0 in 7.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:02 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:10:02 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Converted 1024.00 MB image at 137.07 MB/s Nov 05 15:10:02 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 is being set with open permissions: ugo+rw Nov 05 15:10:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:03 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 Nov 05 15:10:03 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:03 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" released by "_copy_volume_from_snapshot" :: held 8.624s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-d34171e1-3a0b-4fda-b426-74638518b715" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-d34171e1-3a0b-4fda-b426-74638518b715" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Deleting offline snapshot d34171e1-3a0b-4fda-b426-74638518b715 of volume 152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] snapshot_file for this snap is: volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fc07a-e1bc-48c4-ba52-f5bfa43f28b1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:03 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 Nov 05 15:10:03 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:03 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-152fde07-2533-459a-8a83-1cf1e7820c59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d394b3b7-d674-480b-8706-d4bbf1dfce73]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:03 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 Nov 05 15:10:03 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:04 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59" returned: 0 in 0.533s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:04 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 Nov 05 15:10:04 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:04 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715" returned: 0 in 0.340s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:04 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715 Nov 05 15:10:04 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:04 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59.d34171e1-3a0b-4fda-b426-74638518b715" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-d34171e1-3a0b-4fda-b426-74638518b715" released by "_delete_snapshot" :: held 1.734s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.203s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.515s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:05 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Cloning volume 06dacf8a-c121-41fc-81d2-2906e73eea8e to volume abe8b7cc-5d71-4478-b582-3828f2b362c6 Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b131ed9-eed2-4f24-bcb7-a6b8d9617bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6', 'volume_size': 1, 'source_volid': '152fde07-2533-459a-8a83-1cf1e7820c59', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb43ef8b-ff29-41b9-a1c7-087b7d015a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Creating offline snapshot 6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 of volume 06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:10:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Volume volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 (fa9e97b2-8cad-4670-b62b-75aa31fca8c6): created successfully Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb43ef8b-ff29-41b9-a1c7-087b7d015a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (eb4b5554-3e98-46ef-9c36-e526dac9d77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[541242ad-aadf-43d7-bb1a-7398d276bd25]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-05b332e6-ff96-472e-bf74-c97b2da3a7e1 tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:10:05 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e Nov 05 15:10:05 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:05 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e" returned: 0 in 0.438s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:05 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 1G Nov 05 15:10:05 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:06 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 1G" returned: 0 in 0.481s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06dacf8a-c121-41fc-81d2-2906e73eea8e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:06 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06dacf8a-c121-41fc-81d2-2906e73eea8e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 Nov 05 15:10:06 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:06 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06dacf8a-c121-41fc-81d2-2906e73eea8e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:06 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 is being set with open permissions: ugo+rw Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:06 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 Nov 05 15:10:06 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (581fb497-3c1e-4008-8704-be2b0e0a6cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052262cf-bbc8-4cca-b23c-78aede7e6277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052262cf-bbc8-4cca-b23c-78aede7e6277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-584789181',display_name='tempest-VolumesGetTest-Volume-1697256352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7bcda1-a829-4be8-9d34-36c1a7e7705d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:06Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5897f7-dc08-466d-a2b5-c39c6c08cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5897f7-dc08-466d-a2b5-c39c6c08cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb95d3f2-e990-47a0-b1a9-bb3d0a96bd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb95d3f2-e990-47a0-b1a9-bb3d0a96bd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7bcda1-a829-4be8-9d34-36c1a7e7705d', 'volume_name': 'volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc456faf-d666-4059-8f79-3ead930f06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc456faf-d666-4059-8f79-3ead930f06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41d64ce-310c-4752-a2e1-bcda635c71c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Volume 7b7bcda1-a829-4be8-9d34-36c1a7e7705d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d', 'volume_size': 1} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:06 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:06 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info Nov 05 15:10:06 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:06 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:06 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info is being set with open permissions: ugo+rw Nov 05 15:10:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:07 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info Nov 05 15:10:07 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:07 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.info" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Acquiring lock "cinder-quobyte-abe8b7cc-5d71-4478-b582-3828f2b362c6" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-abe8b7cc-5d71-4478-b582-3828f2b362c6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] snapshot: 6f9e1f1e-8bd2-496c-acfb-792fe8787ff8, volume: abe8b7cc-5d71-4478-b582-3828f2b362c6, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed2fdd-199e-43de-a9c0-7efb26bf0208]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:07 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 Nov 05 15:10:07 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:07 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06dacf8a-c121-41fc-81d2-2906e73eea8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e0e60-b912-4d47-a526-972a47fb5ff8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:07 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e Nov 05 15:10:07 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:08 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:10:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:10:08 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:10:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:08 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 Nov 05 15:10:08 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:15 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6" returned: 0 in 7.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:10:15 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Converted 1024.00 MB image at 139.13 MB/s Nov 05 15:10:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 is being set with open permissions: ugo+rw Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:15 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 Nov 05 15:10:15 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:15 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-abe8b7cc-5d71-4478-b582-3828f2b362c6" released by "_copy_volume_from_snapshot" :: held 8.416s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Acquiring lock "cinder-quobyte-6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Deleting offline snapshot 6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 of volume 06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] snapshot_file for this snap is: volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[28311656-fc56-45d2-9949-963c91b11489]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:15 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 Nov 05 15:10:15 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:16 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06dacf8a-c121-41fc-81d2-2906e73eea8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4b69e-380e-4f57-ac5c-540b82537323]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:16 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e Nov 05 15:10:16 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=60,cinder:UPDATE=72,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:10:16 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:16 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 Nov 05 15:10:16 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:17 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:17 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8 Nov 05 15:10:17 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:17 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e.6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-6f9e1f1e-8bd2-496c-acfb-792fe8787ff8" released by "_delete_snapshot" :: held 1.705s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.479s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.984s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1084786565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c052378-367e-43ae-821f-2ec3ba32f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7e53fdadd249e89b5d89740dbe97c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:09:57Z,use_quota=True,user_id='4a62f32f7a1945cca4077c173044e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Creating volume 3c052378-367e-43ae-821f-2ec3ba32f2e4 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:10:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:17 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 1073741824 Nov 05 15:10:17 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51a6421-0795-4724-85ab-117a4d7bdb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe8b7cc-5d71-4478-b582-3828f2b362c6', 'volume_size': 2, 'source_volid': '06dacf8a-c121-41fc-81d2-2906e73eea8e', 'source_volstatus': 'available'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36da211-2e39-4696-b06e-0b220fb66c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Volume volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 (abe8b7cc-5d71-4478-b582-3828f2b362c6): created successfully Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e36da211-2e39-4696-b06e-0b220fb66c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Flow 'volume_create_manager' (d6529fd2-842d-4b2c-8bc2-14a802c77184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d6636c38-32eb-4b2c-b1aa-78d23877c7dd tempest-VolumesCloneTest-913796194 None] Created volume successfully. Nov 05 15:10:17 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 1073741824" returned: 0 in 0.424s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:18 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 Nov 05 15:10:18 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:18 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.635s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-584789181',display_name='tempest-VolumesGetTest-Volume-1697256352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7bcda1-a829-4be8-9d34-36c1a7e7705d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:06Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Creating volume 7b7bcda1-a829-4be8-9d34-36c1a7e7705d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:10:18 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d244b-61ad-45e8-8a05-2946005cfae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c052378-367e-43ae-821f-2ec3ba32f2e4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:18 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d 1073741824 Nov 05 15:10:18 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f198dea-12cd-44df-ad4b-57bf877aabba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Volume volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 (3c052378-367e-43ae-821f-2ec3ba32f2e4): created successfully Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f198dea-12cd-44df-ad4b-57bf877aabba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Flow 'volume_create_manager' (5cb550ba-a9f7-4ea3-8f4b-3e0eb237f839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b3061bd1-c262-4094-b877-7e2a9e790c42 tempest-AttachVolumeTestJSON-1944887255 None] Created volume successfully. Nov 05 15:10:18 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d 1073741824" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:18 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d Nov 05 15:10:18 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Acquiring lock "cinder-abe8b7cc-5d71-4478-b582-3828f2b362c6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Lock "cinder-abe8b7cc-5d71-4478-b582-3828f2b362c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:19 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Acquiring lock "cinder-quobyte-abe8b7cc-5d71-4478-b582-3828f2b362c6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41d64ce-310c-4752-a2e1-bcda635c71c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a200938d-4eb5-4753-a2bf-cb5c6d7c5715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-abe8b7cc-5d71-4478-b582-3828f2b362c6" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Volume volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d (7b7bcda1-a829-4be8-9d34-36c1a7e7705d): created successfully Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a200938d-4eb5-4753-a2bf-cb5c6d7c5715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (581fb497-3c1e-4008-8704-be2b0e0a6cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[825bde0f-2792-4a28-9289-e8b528dcb4c9]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fe1d11ed-b8dd-4b4a-a776-0fae3153325a tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:10:19 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 Nov 05 15:10:19 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:19 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6" returned: 0 in 0.480s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:19 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6 Nov 05 15:10:19 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-7b7bcda1-a829-4be8-9d34-36c1a7e7705d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Lock "cinder-7b7bcda1-a829-4be8-9d34-36c1a7e7705d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-7b7bcda1-a829-4be8-9d34-36c1a7e7705d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-7b7bcda1-a829-4be8-9d34-36c1a7e7705d" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f67bae0-fa65-4b3b-92c4-911d1529d928]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:20 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-abe8b7cc-5d71-4478-b582-3828f2b362c6" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-abe8b7cc-5d71-4478-b582-3828f2b362c6" released by "delete_volume" :: held 0.910s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:20 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d Nov 05 15:10:20 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Created reservations ['b49819cc-4d67-4b06-b89b-79f969be57fb', '05c69aad-74ab-4ae5-92e0-c136a136d223', 'f89ce5cb-2106-47d3-bffc-3e56d1f3b3ef', '8e2e9562-6de5-404d-8a54-7e6e83a6dad0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:20 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:20 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b59e1c91-8d32-4b36-b538-60cab4911c22 req-87cce224-aea2-400b-87a9-62943357b9f8 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b59e1c91-8d32-4b36-b538-60cab4911c22 req-87cce224-aea2-400b-87a9-62943357b9f8 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:20 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-b59e1c91-8d32-4b36-b538-60cab4911c22 req-87cce224-aea2-400b-87a9-62943357b9f8 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d" returned: 0 in 0.464s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:20 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d Nov 05 15:10:20 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-b59e1c91-8d32-4b36-b538-60cab4911c22 req-87cce224-aea2-400b-87a9-62943357b9f8 tempest-AttachVolumeTestJSON-1944887255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-3c052378-367e-43ae-821f-2ec3ba32f2e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c2433eb-4ce1-4ad0-a25d-b544335aec85', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:10:20 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Deleted volume successfully. Nov 05 15:10:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-b59e1c91-8d32-4b36-b538-60cab4911c22 req-87cce224-aea2-400b-87a9-62943357b9f8 tempest-AttachVolumeTestJSON-1944887255 None] attachment_update completed successfully. Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2dae63a7-fa6c-4cfd-9f85-c6e7ff7d3ac7 tempest-VolumesCloneTest-913796194 None] Lock "cinder-abe8b7cc-5d71-4478-b582-3828f2b362c6-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:20 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b7bcda1-a829-4be8-9d34-36c1a7e7705d" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-7b7bcda1-a829-4be8-9d34-36c1a7e7705d" released by "delete_volume" :: held 0.797s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Created reservations ['13a60bc1-8771-4761-9c51-86a827bb89b6', '064fc70f-1fa7-41af-be18-71628c08a3c4', '2ab02745-4c68-46fe-a1d9-2c576f111c25', 'd7aa8853-12bb-4f94-8c76-b50cb64968b1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:20 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:20 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-fa9e97b2-8cad-4670-b62b-75aa31fca8c6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Lock "cinder-fa9e97b2-8cad-4670-b62b-75aa31fca8c6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" acquired by "delete_volume" :: waited 0.062s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Acquiring lock "cinder-06dacf8a-c121-41fc-81d2-2906e73eea8e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:21 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.551s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Lock "cinder-06dacf8a-c121-41fc-81d2-2906e73eea8e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f68d401-6b05-49ad-a9a4-d10c1604d387]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2a24dce8-390d-446a-a15d-fce6510732e2 tempest-VolumesGetTest-44830152 None] Lock "cinder-7b7bcda1-a829-4be8-9d34-36c1a7e7705d-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Acquiring lock "cinder-quobyte-06dacf8a-c121-41fc-81d2-2906e73eea8e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-06dacf8a-c121-41fc-81d2-2906e73eea8e" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:21 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 Nov 05 15:10:21 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[715beca7-8296-494d-a8af-e2a487b85094]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:21 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e Nov 05 15:10:21 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:22 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" returned: 0 in 0.676s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:22 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e" returned: 0 in 0.500s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:22 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6 Nov 05 15:10:22 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:22 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e Nov 05 15:10:22 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:22 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:22 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-fa9e97b2-8cad-4670-b62b-75aa31fca8c6" released by "delete_volume" :: held 1.311s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-06dacf8a-c121-41fc-81d2-2906e73eea8e" returned: 0 in 0.487s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Lock "cinder-quobyte-06dacf8a-c121-41fc-81d2-2906e73eea8e" released by "delete_volume" :: held 1.117s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Created reservations ['d5ed7b8c-1484-4f08-9eea-43abcf5a9132', 'ebca4cc2-763e-4f01-830b-1342037fed89', 'ded35aea-ced5-4d02-9086-8ab4a0e54446', '64d198c9-2a90-4849-a553-dbc9e327809a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Created reservations ['f075810b-15de-457b-afc8-a6dc0f02adeb', '5adcfe69-5ccf-486e-bb14-bb91ba48f200', '6ebf90e5-7389-47b9-afe7-811fc334b3f9', '0feaa6eb-687b-4e8a-a09f-594ab9a54e5a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:23 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:23 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:23 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:23 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:23 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03dc25e2-d83a-4246-bcb9-c850a2fafb0c tempest-VolumesGetTest-44830152 None] Lock "cinder-fa9e97b2-8cad-4670-b62b-75aa31fca8c6-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:23 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.319s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Deleted volume successfully. Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d0f951f-49a2-443f-ac1e-358dc7c3f616 tempest-VolumesCloneTest-913796194 None] Lock "cinder-06dacf8a-c121-41fc-81d2-2906e73eea8e-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-152fde07-2533-459a-8a83-1cf1e7820c59-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Lock "cinder-152fde07-2533-459a-8a83-1cf1e7820c59-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-152fde07-2533-459a-8a83-1cf1e7820c59" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-152fde07-2533-459a-8a83-1cf1e7820c59" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4024b9a0-64b9-45e6-a776-fad860f161dd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:23 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 Nov 05 15:10:23 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:24 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59" returned: 0 in 0.433s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:24 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59 Nov 05 15:10:24 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:24 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-152fde07-2533-459a-8a83-1cf1e7820c59" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-152fde07-2533-459a-8a83-1cf1e7820c59" released by "delete_volume" :: held 0.810s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Created reservations ['1554ca81-fdc3-4414-9514-5ac87843e917', 'bd10cb6a-ee98-432e-999e-af6a4e426ebf', '999b0431-346a-4b8b-bb76-330c4c67410a', 'd6cd5b79-d023-4176-bdd9-268e043284c8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:24 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:24 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:25 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9d85ab57-a068-448c-8f57-d08f6531bb16 tempest-VolumesGetTest-44830152 None] Lock "cinder-152fde07-2533-459a-8a83-1cf1e7820c59-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (d48bdc6f-bcac-45ce-8243-c2a04f7a4fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e9e6a1-1027-4f90-b164-4e3675a9185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e9e6a1-1027-4f90-b164-4e3675a9185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-913544010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa89b67-f45b-4ffb-8ddb-4f3c5d37c524,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:26Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169161fb-2a35-4f49-86f3-8f3c0a50f8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169161fb-2a35-4f49-86f3-8f3c0a50f8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4929dc2f-3bb9-4d88-b7fd-a1a76982b3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:25 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:10:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4929dc2f-3bb9-4d88-b7fd-a1a76982b3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'faa89b67-f45b-4ffb-8ddb-4f3c5d37c524', 'volume_name': 'volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20ae129-3c80-4a68-b5ae-0d55857451be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c20ae129-3c80-4a68-b5ae-0d55857451be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985c3be2-c81d-4f9c-ae9c-3d924ce7a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Volume faa89b67-f45b-4ffb-8ddb-4f3c5d37c524: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 15:10:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Trying to clone faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 from image a5728ae6-576a-47f4-a55c-199ed63578be at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:10:26 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:10:26 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Image download 20.69 MB at 20.69 MB/s Nov 05 15:10:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a46b4b-951b-4a6f-94c8-94f1644df33a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:27 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD Nov 05 15:10:27 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:27 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD" returned: 0 in 0.632s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:27 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be is fetched for user 8f33a1de5bdb4f34889868b046ce1771. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:10:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db9b1a4-3cc9-4eca-bda3-04bc2a1d1c7d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:27 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD Nov 05 15:10:27 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:28 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD" returned: 0 in 0.597s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-913544010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa89b67-f45b-4ffb-8ddb-4f3c5d37c524,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:26Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Creating volume faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:10:28 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:10:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:28 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 1073741824 Nov 05 15:10:28 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:29 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 1073741824" returned: 0 in 0.805s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:29 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 Nov 05 15:10:29 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:29 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Attempting download of a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume faa89b67-f45b-4ffb-8ddb-4f3c5d37c524. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a6788-e590-4c44-bdef-ad31f3b10e64]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:30 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr Nov 05 15:10:30 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Flow 'volume_create_manager' (a05493c5-5f32-4c07-9481-8a11bea8a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36de7633-3d80-4e2e-8bf5-7218433fcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:30 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr" returned: 0 in 0.730s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36de7633-3d80-4e2e-8bf5-7218433fcb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-472299431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e84af2-5aa6-4bb2-9da1-26a7fce88259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40bc7de38ef4391b30846c052b34a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:31Z,use_quota=True,user_id='1494daaa7a24454887cb72a132d09647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0197c3e0-ec45-4c8f-954f-bacdb05130eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0197c3e0-ec45-4c8f-954f-bacdb05130eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cba73a-27b4-4a28-a86c-7f0ce727f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cba73a-27b4-4a28-a86c-7f0ce727f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e84af2-5aa6-4bb2-9da1-26a7fce88259', 'volume_name': 'volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a861b5fc-5ba4-4d1d-a160-8eacad3d7f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a861b5fc-5ba4-4d1d-a160-8eacad3d7f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5340447a-a25f-4519-a290-03d28e2b46cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Volume 64e84af2-5aa6-4bb2-9da1-26a7fce88259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259', 'volume_size': 1} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-472299431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e84af2-5aa6-4bb2-9da1-26a7fce88259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f40bc7de38ef4391b30846c052b34a57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:31Z,use_quota=True,user_id='1494daaa7a24454887cb72a132d09647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Creating volume 64e84af2-5aa6-4bb2-9da1-26a7fce88259 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:10:30 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:10:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:30 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 1073741824 Nov 05 15:10:30 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:30 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr Nov 05 15:10:30 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:31 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr" returned: 1 in 0.553s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_rdlcjwnr' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3482408c-638a-4b95-ba18-002a2c8e7cee]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:31 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD Nov 05 15:10:31 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:31 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 1073741824" returned: 0 in 0.840s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:31 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 Nov 05 15:10:31 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:31 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:31 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] a5728ae6-576a-47f4-a55c-199ed63578be was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:32 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 Nov 05 15:10:32 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:32 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5340447a-a25f-4519-a290-03d28e2b46cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f1439a-a71e-4faa-881b-4f208756471d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Volume volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 (64e84af2-5aa6-4bb2-9da1-26a7fce88259): created successfully Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f1439a-a71e-4faa-881b-4f208756471d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Flow 'volume_create_manager' (a05493c5-5f32-4c07-9481-8a11bea8a494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-29e75c45-364c-4802-9701-c1febdadeb73 tempest-VolumesNegativeTest-1786331781 None] Created volume successfully. Nov 05 15:10:34 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" returned: 0 in 2.871s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:34 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_dhchyre5devstack@QuobyteHD, size 112.00 MB, duration 2.87 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:10:34 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Converted 112.00 MB image at 39.00 MB/s Nov 05 15:10:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:34 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 1G Nov 05 15:10:34 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:35 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 1G" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Downloaded image a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be for user 8f33a1de5bdb4f34889868b046ce1771 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Marking volume faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Copying metadata from image a5728ae6-576a-47f4-a55c-199ed63578be to faa89b67-f45b-4ffb-8ddb-4f3c5d37c524. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Creating volume glance metadata for volume faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 backed by image a5728ae6-576a-47f4-a55c-199ed63578be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=104,cinder:UPDATE=121,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (985c3be2-c81d-4f9c-ae9c-3d924ce7a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06671e3-28e5-42ed-9558-9dae54e68ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Volume volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 (faa89b67-f45b-4ffb-8ddb-4f3c5d37c524): created successfully Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06671e3-28e5-42ed-9558-9dae54e68ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (d48bdc6f-bcac-45ce-8243-c2a04f7a4fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-13fe08fb-e372-42e4-a235-f9ac77e82673 tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (cbb23cea-b59f-4bd2-bad9-38a1adead48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b05ef6-2852-4fc1-a667-bacc4ba8fc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b05ef6-2852-4fc1-a667-bacc4ba8fc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1941716977',display_name='tempest-VolumesGetTest-Volume-1136342347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0086c5-3262-420b-984a-09cd5631e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:37Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e90a9-fa79-4aae-a7a0-8b81d4decbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e90a9-fa79-4aae-a7a0-8b81d4decbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcd9581-ae61-4ee2-8462-fcda22cbfa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcd9581-ae61-4ee2-8462-fcda22cbfa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0086c5-3262-420b-984a-09cd5631e672', 'volume_name': 'volume-bc0086c5-3262-420b-984a-09cd5631e672', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb97034-022c-47b7-b4f2-1c021466a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cb97034-022c-47b7-b4f2-1c021466a490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e157a39-829f-4bf9-b701-79a26e029dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Volume bc0086c5-3262-420b-984a-09cd5631e672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0086c5-3262-420b-984a-09cd5631e672', 'volume_size': 1} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1941716977',display_name='tempest-VolumesGetTest-Volume-1136342347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0086c5-3262-420b-984a-09cd5631e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b19d3d1a6b7449ec92cfed168f32c08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:37Z,use_quota=True,user_id='8f33a1de5bdb4f34889868b046ce1771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Creating volume bc0086c5-3262-420b-984a-09cd5631e672 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:10:37 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:37 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 1073741824 Nov 05 15:10:37 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:37 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 1073741824" returned: 0 in 0.591s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:37 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 Nov 05 15:10:37 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:38 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e157a39-829f-4bf9-b701-79a26e029dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0086c5-3262-420b-984a-09cd5631e672', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbcd70c-32df-4e64-8cdc-c58f2d9c8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Volume volume-bc0086c5-3262-420b-984a-09cd5631e672 (bc0086c5-3262-420b-984a-09cd5631e672): created successfully Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbcd70c-32df-4e64-8cdc-c58f2d9c8b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Flow 'volume_create_manager' (cbb23cea-b59f-4bd2-bad9-38a1adead48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-94ba693f-06d0-4333-9eb4-39f7763c9d31 tempest-VolumesGetTest-44830152 None] Created volume successfully. Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:39 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:39 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-bc0086c5-3262-420b-984a-09cd5631e672-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Lock "cinder-bc0086c5-3262-420b-984a-09cd5631e672-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-bc0086c5-3262-420b-984a-09cd5631e672" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-bc0086c5-3262-420b-984a-09cd5631e672" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:39 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f774730-7a2c-48e2-88ca-9608c3b44c75]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:39 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 Nov 05 15:10:39 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:40 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672" returned: 0 in 0.798s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:40 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672 Nov 05 15:10:40 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:40 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc0086c5-3262-420b-984a-09cd5631e672" returned: 0 in 0.608s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-bc0086c5-3262-420b-984a-09cd5631e672" released by "delete_volume" :: held 1.504s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Created reservations ['0daaa677-8743-4b2e-bffd-de9ee4969082', '93b563ea-361a-4d48-b29d-144281cb8f58', 'd6b4d77a-8304-4c18-b6fb-a542ccdf4f70', '82f9a009-48f3-4517-a231-c67e15d4c457'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:41 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:41 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:41 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.513s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a34969eb-dc92-467b-a388-8b550c1208f6 tempest-VolumesGetTest-44830152 None] Lock "cinder-bc0086c5-3262-420b-984a-09cd5631e672-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Lock "cinder-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Acquiring lock "cinder-quobyte-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" acquired by "delete_volume" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d3e648-f7ab-4c4b-9e3e-1ef3203a45fc]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:42 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 Nov 05 15:10:42 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:43 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" returned: 0 in 0.746s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:43 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524 Nov 05 15:10:43 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:43 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" returned: 0 in 0.570s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Lock "cinder-quobyte-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524" released by "delete_volume" :: held 1.423s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Created reservations ['ba325cc2-c9e3-416c-b985-e7aeb7799cd0', '25529fe8-0848-47c2-b7cc-554c069f96c1', '7ec1908c-28ad-423f-ad04-f403eeaf59ed', '6d965f69-8d84-42fd-8675-03ca5e066831'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:44 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:44 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:44 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.657s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Deleted volume successfully. Nov 05 15:10:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f98ec40-8ddd-421e-aa0a-fdaeed3f10cf tempest-VolumesGetTest-44830152 None] Lock "cinder-faa89b67-f45b-4ffb-8ddb-4f3c5d37c524-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Flow 'volume_create_manager' (428d9e6b-0a72-4497-b0f9-0ca42b4596ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4b9cba-6db7-4a30-9c2d-e86f6f8d637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4b9cba-6db7-4a30-9c2d-e86f6f8d637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1567557414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982a8a7f-d577-47a6-82f9-51258bb64490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9c18e1e2a24b769a05c2ab14de0270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:49Z,use_quota=True,user_id='bbf3c30da00c4c67b77d6362c957b660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506d0e22-0ff8-4b02-9cf3-ba522de03fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506d0e22-0ff8-4b02-9cf3-ba522de03fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df77d2a7-1b48-4e8a-88d9-c05b8b3e026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df77d2a7-1b48-4e8a-88d9-c05b8b3e026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982a8a7f-d577-47a6-82f9-51258bb64490', 'volume_name': 'volume-982a8a7f-d577-47a6-82f9-51258bb64490', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36b7231-5e43-4538-ad99-386b75fb4d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36b7231-5e43-4538-ad99-386b75fb4d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e899c765-bee0-4523-bbd2-10bb1b55e76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Volume 982a8a7f-d577-47a6-82f9-51258bb64490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982a8a7f-d577-47a6-82f9-51258bb64490', 'volume_size': 1} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1567557414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982a8a7f-d577-47a6-82f9-51258bb64490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b9c18e1e2a24b769a05c2ab14de0270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:10:49Z,use_quota=True,user_id='bbf3c30da00c4c67b77d6362c957b660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Creating volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:10:49 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:49 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 1073741824 Nov 05 15:10:49 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:49 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 1073741824" returned: 0 in 0.545s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:49 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 Nov 05 15:10:49 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:50 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e899c765-bee0-4523-bbd2-10bb1b55e76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982a8a7f-d577-47a6-82f9-51258bb64490', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11dbae-0e83-4367-8cb7-e5eb7835c5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:10:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Volume volume-982a8a7f-d577-47a6-82f9-51258bb64490 (982a8a7f-d577-47a6-82f9-51258bb64490): created successfully Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b11dbae-0e83-4367-8cb7-e5eb7835c5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:10:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Flow 'volume_create_manager' (428d9e6b-0a72-4497-b0f9-0ca42b4596ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:10:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4d567106-c1b3-4a7b-8f23-5dbf0a581d74 tempest-VolumesSnapshotListTestJSON-410317429 None] Created volume successfully. Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Creating offline snapshot a54646fb-4186-4dca-8762-b406c7c0187e of volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4466f0d9-00f8-4ab6-b4d1-ac3efce076b3]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:51 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 Nov 05 15:10:51 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:51 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490" returned: 0 in 0.457s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:52 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e 1G Nov 05 15:10:52 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:52 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e 1G" returned: 0 in 0.562s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:52 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:10:52 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:52 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.322s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:52 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e is being set with open permissions: ugo+rw Nov 05 15:10:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:52 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:10:52 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:53 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:53 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info Nov 05 15:10:53 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:53 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info" returned: 0 in 0.294s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:53 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info is being set with open permissions: ugo+rw Nov 05 15:10:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:53 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info Nov 05 15:10:53 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:53 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.info" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0b7c3ef1-ec8c-4417-a7a0-64b79ace47e4 tempest-VolumesSnapshotListTestJSON-410317429 None] Create snapshot completed successfully Nov 05 15:10:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Creating offline snapshot 0a1cffd2-5a83-438e-b4fc-52393513d265 of volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeb0b30-f2f0-4b8b-85a1-546d888b772f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-cabf84fc-a1f3-46b1-981d-b9a2ccf7b231 req-1cd70e68-d2a4-484e-bc92-e42d1d319ef2 tempest-AttachVolumeTestJSON-1944887255 None] Terminate volume connection completed successfully. Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-cabf84fc-a1f3-46b1-981d-b9a2ccf7b231 req-1cd70e68-d2a4-484e-bc92-e42d1d319ef2 tempest-AttachVolumeTestJSON-1944887255 None] Deleting attachment 8c2433eb-4ce1-4ad0-a25d-b544335aec85. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:10:55 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:10:55 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Acquiring lock "cinder-64e84af2-5aa6-4bb2-9da1-26a7fce88259-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Lock "cinder-64e84af2-5aa6-4bb2-9da1-26a7fce88259-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Acquiring lock "cinder-quobyte-64e84af2-5aa6-4bb2-9da1-26a7fce88259" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Lock "cinder-quobyte-64e84af2-5aa6-4bb2-9da1-26a7fce88259" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f088e7-07ec-495c-9db5-651eb297da04]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:55 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.532s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:10:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:55 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 Nov 05 15:10:55 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:55 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 1G Nov 05 15:10:55 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:56 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259" returned: 0 in 0.539s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:56 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259 Nov 05 15:10:56 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:56 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 1G" returned: 0 in 0.760s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:56 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:10:56 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:56 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-64e84af2-5aa6-4bb2-9da1-26a7fce88259" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Lock "cinder-quobyte-64e84af2-5aa6-4bb2-9da1-26a7fce88259" released by "delete_volume" :: held 0.992s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Created reservations ['9c998eb8-fbd0-417f-885f-3e1f7e537de7', 'c4327e5d-3033-4c26-9b14-e7fad7fba3f6', '0d9d662c-1484-43f4-be22-d42d8734812c', '3cf8d8e3-8e0d-4cfd-b595-25723fbe2094'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:56 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:10:56 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:56 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:56 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 is being set with open permissions: ugo+rw Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:56 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:10:56 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:56 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:10:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Deleted volume successfully. Nov 05 15:10:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-109cf916-b484-4719-a639-5ab384a11d8e tempest-VolumesNegativeTest-1786331781 None] Lock "cinder-64e84af2-5aa6-4bb2-9da1-26a7fce88259-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:10:57 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:10:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b5df7e6e-24a5-44e5-8eb7-13554c16879a tempest-VolumesSnapshotListTestJSON-410317429 None] Create snapshot completed successfully Nov 05 15:10:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:10:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:10:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Creating offline snapshot e64c0bd3-5ce4-4b77-b642-697fe089f498 of volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:10:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b247fc1-346b-4c1c-b4f9-690e844559f8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:10:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:58 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:10:58 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:59 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 0.484s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:10:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:59 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 1G Nov 05 15:10:59 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:10:59 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Nov 05 15:10:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 1G" returned: 0 in 0.730s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:10:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:10:59 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 Nov 05 15:10:59 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:00 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498" returned: 0 in 0.498s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:00 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 is being set with open permissions: ugo+rw Nov 05 15:11:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:00 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 Nov 05 15:11:00 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:00 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498" returned: 0 in 0.693s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5e06a5c0-e01d-43cc-b291-ceeb235b1aaf tempest-VolumesSnapshotListTestJSON-410317429 None] Create snapshot completed successfully Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-e64c0bd3-5ce4-4b77-b642-697fe089f498-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-e64c0bd3-5ce4-4b77-b642-697fe089f498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-e64c0bd3-5ce4-4b77-b642-697fe089f498" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-e64c0bd3-5ce4-4b77-b642-697fe089f498" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Deleting offline snapshot e64c0bd3-5ce4-4b77-b642-697fe089f498 of volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] snapshot_file for this snap is: volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4bc53-ebe6-482a-85c8-94b875226616]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:04 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 Nov 05 15:11:04 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:05 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498" returned: 0 in 0.665s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bca5a3e-f61a-4c30-9cab-88a33c35ece0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:05 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:11:05 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:05 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 0.587s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:11:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:05 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 Nov 05 15:11:05 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:06 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498" returned: 0 in 1.042s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:06 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498 Nov 05 15:11:06 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:07 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.e64c0bd3-5ce4-4b77-b642-697fe089f498" returned: 0 in 0.471s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-e64c0bd3-5ce4-4b77-b642-697fe089f498" released by "_delete_snapshot" :: held 3.002s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" released by "delete_snapshot" :: held 3.075s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:07 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Created reservations ['ccb21bc2-e480-4d3c-a33c-f36a3a8c4bc9', '2e8a0209-8de1-4721-820b-c3822eeba10b', 'ba1366f9-ff68-4d8f-93c6-5efce6567cbd', '3417a4c7-7613-4770-9f95-ba7bf670543d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:11:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Delete snapshot completed successfully. Nov 05 15:11:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fe81d006-8830-4614-9871-4630553085c0 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-e64c0bd3-5ce4-4b77-b642-697fe089f498-delete_snapshot" released by "delete_snapshot" :: held 3.292s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Flow 'volume_create_manager' (54aaebbc-7317-449c-9c43-84ea7384acdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ad9708-6731-4e01-a7a8-891e049e84d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ad9708-6731-4e01-a7a8-891e049e84d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-383900155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949f76c4-8aa3-4763-9d2e-1193b288c1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ac9ee287d346528fad55e73115ba07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:08Z,use_quota=True,user_id='ca3cd30785aa461f973287dc31131b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33eb59c-0384-4014-b08f-7ee8594eccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33eb59c-0384-4014-b08f-7ee8594eccac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009af5c4-5df1-4661-9ff4-49a339b6b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009af5c4-5df1-4661-9ff4-49a339b6b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949f76c4-8aa3-4763-9d2e-1193b288c1a0', 'volume_name': 'volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e993ef8-097b-4eb3-938b-8cfbd0d9f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e993ef8-097b-4eb3-938b-8cfbd0d9f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59deaf1d-7439-406f-9742-d9fb39f533b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:08 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Volume 949f76c4-8aa3-4763-9d2e-1193b288c1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0', 'volume_size': 1} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-383900155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949f76c4-8aa3-4763-9d2e-1193b288c1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20ac9ee287d346528fad55e73115ba07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:08Z,use_quota=True,user_id='ca3cd30785aa461f973287dc31131b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Creating volume 949f76c4-8aa3-4763-9d2e-1193b288c1a0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:11:08 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:08 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 1073741824 Nov 05 15:11:08 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-0a1cffd2-5a83-438e-b4fc-52393513d265-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-0a1cffd2-5a83-438e-b4fc-52393513d265-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-0a1cffd2-5a83-438e-b4fc-52393513d265" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-0a1cffd2-5a83-438e-b4fc-52393513d265" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Deleting offline snapshot 0a1cffd2-5a83-438e-b4fc-52393513d265 of volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] snapshot_file for this snap is: volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b8e29a-3384-460d-b37c-c821c5e32679]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:09 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 1073741824" returned: 0 in 0.732s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:09 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:11:09 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:09 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 Nov 05 15:11:09 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:09 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 0.595s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d59016-ce19-48d8-9d7d-b86a5a51d156]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:09 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0" returned: 0 in 0.478s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59deaf1d-7439-406f-9742-d9fb39f533b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c2dccf-530a-432b-8b44-074a0d4e62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:09 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Volume volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 (949f76c4-8aa3-4763-9d2e-1193b288c1a0): created successfully Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c2dccf-530a-432b-8b44-074a0d4e62e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Flow 'volume_create_manager' (54aaebbc-7317-449c-9c43-84ea7384acdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:11:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f8787c96-a9ff-4239-8bb2-e516ea6420c0 tempest-TestMinimumBasicScenario-1564171368 None] Created volume successfully. Nov 05 15:11:09 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:11:09 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:10 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.658s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:11:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:10 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:11:10 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:11 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 1.067s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:11 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265 Nov 05 15:11:11 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:11 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.0a1cffd2-5a83-438e-b4fc-52393513d265" returned: 0 in 0.527s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-0a1cffd2-5a83-438e-b4fc-52393513d265" released by "_delete_snapshot" :: held 3.029s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" released by "delete_snapshot" :: held 3.107s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:12 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Created reservations ['a7f6e5e4-2238-45c9-a4a9-28edc94c2038', 'fbcf8507-39b2-438a-be21-b25590170a26', '129dda58-3995-4283-ac06-6d3dd63a8371', '06160ddf-a73e-4b4a-9ba5-7e83be79cf41'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:11:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Delete snapshot completed successfully. Nov 05 15:11:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4274ece1-ccf3-49df-a062-af0a43c3b062 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-0a1cffd2-5a83-438e-b4fc-52393513d265-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8354460c-3ce9-406b-ab9c-8d9d7d0cac2b req-3acef30c-431e-4dd9-ba17-adada19404b1 tempest-TestMinimumBasicScenario-1564171368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8354460c-3ce9-406b-ab9c-8d9d7d0cac2b req-3acef30c-431e-4dd9-ba17-adada19404b1 tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-8354460c-3ce9-406b-ab9c-8d9d7d0cac2b req-3acef30c-431e-4dd9-ba17-adada19404b1 tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8354460c-3ce9-406b-ab9c-8d9d7d0cac2b req-3acef30c-431e-4dd9-ba17-adada19404b1 tempest-TestMinimumBasicScenario-1564171368 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f902ae4a-7ce1-43c2-9720-fdfbc912e66f', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:11:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-8354460c-3ce9-406b-ab9c-8d9d7d0cac2b req-3acef30c-431e-4dd9-ba17-adada19404b1 tempest-TestMinimumBasicScenario-1564171368 None] attachment_update completed successfully. Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-a54646fb-4186-4dca-8762-b406c7c0187e-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-a54646fb-4186-4dca-8762-b406c7c0187e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-a54646fb-4186-4dca-8762-b406c7c0187e" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-a54646fb-4186-4dca-8762-b406c7c0187e" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Deleting offline snapshot a54646fb-4186-4dca-8762-b406c7c0187e of volume 982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] snapshot_file for this snap is: volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ff6b0-1fe4-4e49-88d0-2678d610fc63]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:13 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:11:13 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:14 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.709s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-982a8a7f-d577-47a6-82f9-51258bb64490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:11:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d971241-a625-4ab6-890e-b960d4139464]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:14 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 Nov 05 15:11:14 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:15 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490" returned: 0 in 0.700s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:15 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:11:15 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:15 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.653s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:15 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e Nov 05 15:11:15 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:16 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490.a54646fb-4186-4dca-8762-b406c7c0187e" returned: 0 in 0.575s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-a54646fb-4186-4dca-8762-b406c7c0187e" released by "_delete_snapshot" :: held 2.929s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" released by "delete_snapshot" :: held 2.989s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Created reservations ['c9d526e1-b972-4d07-940a-2bb568746b06', 'dd7342ed-c5d6-44c0-8b5f-67e974626e42', 'dbee58ff-b052-4313-8753-367007854e6d', '0b45d347-a9ce-4b32-b8b5-88d30a56b1c8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:11:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Delete snapshot completed successfully. Nov 05 15:11:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-382d563e-bee1-47bf-95ed-11a2c88ce4fa tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-a54646fb-4186-4dca-8762-b406c7c0187e-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-982a8a7f-d577-47a6-82f9-51258bb64490-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-982a8a7f-d577-47a6-82f9-51258bb64490-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:17 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=113,cinder:SELECT=94,cinder:INSERT=35,cinder:DELETE=13 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:11:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:11:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:11:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c02c47c-e5cd-434e-af12-ebd365953728]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:11:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:18 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 Nov 05 15:11:18 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:18 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490" returned: 0 in 0.556s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:18 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490 Nov 05 15:11:18 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:19 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-982a8a7f-d577-47a6-82f9-51258bb64490" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-quobyte-982a8a7f-d577-47a6-82f9-51258bb64490" released by "delete_volume" :: held 1.025s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Created reservations ['f31eb0f3-227b-4fa1-b9bd-e8c0c2826323', '19a83f70-9a6d-49c0-8402-5299cf5d77b9', '16d76ed3-a5c4-43f6-9f3a-264007fbf5fc', '65ff6d68-a3a5-4bba-bb19-52b907076ef3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:19 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:11:19 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:19 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:11:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Deleted volume successfully. Nov 05 15:11:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3caf49bd-53b4-4240-9bdd-c9a4176b24d1 tempest-VolumesSnapshotListTestJSON-410317429 None] Lock "cinder-982a8a7f-d577-47a6-82f9-51258bb64490-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:11:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:11:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:INSERT=22,cinder:SELECT=61,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Flow 'volume_create_manager' (35c90f02-393a-46f3-9aae-9dbeb7ce4bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbe6c6-37f1-4bfd-9e92-7c6d6d564b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3abbe6c6-37f1-4bfd-9e92-7c6d6d564b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-322168600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f3e016-2126-4128-ae2b-fdfe20764a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb325cb29e04c8d822dbf0aa8daa0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:35Z,use_quota=True,user_id='8d4457798a3345ed8e59cd47860df0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ade82a-82a9-428b-b446-8464c13a01c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ade82a-82a9-428b-b446-8464c13a01c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47b3765-0021-4e9e-ac9c-cea165f694c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47b3765-0021-4e9e-ac9c-cea165f694c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f3e016-2126-4128-ae2b-fdfe20764a1e', 'volume_name': 'volume-77f3e016-2126-4128-ae2b-fdfe20764a1e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb93045-1cb8-4573-978b-3bf6d72e43b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb93045-1cb8-4573-978b-3bf6d72e43b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca19d708-6976-4c51-9bc6-952bf96c8dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Volume 77f3e016-2126-4128-ae2b-fdfe20764a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f3e016-2126-4128-ae2b-fdfe20764a1e', 'volume_size': 1} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-322168600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f3e016-2126-4128-ae2b-fdfe20764a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb325cb29e04c8d822dbf0aa8daa0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:35Z,use_quota=True,user_id='8d4457798a3345ed8e59cd47860df0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Creating volume 77f3e016-2126-4128-ae2b-fdfe20764a1e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:11:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:11:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:34 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e 1073741824 Nov 05 15:11:34 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Flow 'volume_create_manager' (e6c50ac1-e9b8-4054-9864-a391f1d75b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e653aeb8-9100-4727-aa8d-4dc24943a619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e653aeb8-9100-4727-aa8d-4dc24943a619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2043536481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84ae9d8-f30b-4b45-81e7-6534b6a7ab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb325cb29e04c8d822dbf0aa8daa0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:35Z,use_quota=True,user_id='8d4457798a3345ed8e59cd47860df0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7467047b-2e16-4d95-9ee9-50cd4a976595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7467047b-2e16-4d95-9ee9-50cd4a976595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8cb897-0c10-409e-8f33-fe3452b19efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8cb897-0c10-409e-8f33-fe3452b19efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f84ae9d8-f30b-4b45-81e7-6534b6a7ab10', 'volume_name': 'volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e00f2c-4bb5-4dfa-aa1a-6975cf0e1026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e00f2c-4bb5-4dfa-aa1a-6975cf0e1026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5248b-f99a-4463-9bb3-977df4405168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Volume f84ae9d8-f30b-4b45-81e7-6534b6a7ab10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10', 'volume_size': 1} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:35 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e 1073741824" returned: 0 in 0.899s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:35 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e Nov 05 15:11:35 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:36 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2043536481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84ae9d8-f30b-4b45-81e7-6534b6a7ab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bb325cb29e04c8d822dbf0aa8daa0ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:11:35Z,use_quota=True,user_id='8d4457798a3345ed8e59cd47860df0c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Creating volume f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:11:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca19d708-6976-4c51-9bc6-952bf96c8dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f3e016-2126-4128-ae2b-fdfe20764a1e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad4b53f-c22b-41da-bd63-44056f5dc6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:36 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 1073741824 Nov 05 15:11:36 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Volume volume-77f3e016-2126-4128-ae2b-fdfe20764a1e (77f3e016-2126-4128-ae2b-fdfe20764a1e): created successfully Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad4b53f-c22b-41da-bd63-44056f5dc6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Flow 'volume_create_manager' (35c90f02-393a-46f3-9aae-9dbeb7ce4bb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:11:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3f898060-5d2b-4819-9d49-af5f4da3b34c tempest-TestServerVolumeAttachmentScenario-291438974 None] Created volume successfully. Nov 05 15:11:36 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 1073741824" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:36 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 Nov 05 15:11:36 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:37 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5248b-f99a-4463-9bb3-977df4405168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4f21ac-749b-488b-bfdb-c612abd89489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:11:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Volume volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 (f84ae9d8-f30b-4b45-81e7-6534b6a7ab10): created successfully Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab4f21ac-749b-488b-bfdb-c612abd89489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:11:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Flow 'volume_create_manager' (e6c50ac1-e9b8-4054-9864-a391f1d75b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:11:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dbb537c1-83bc-4e1c-99af-2d5de399462f tempest-TestServerVolumeAttachmentScenario-291438974 None] Created volume successfully. Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:11:39 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:11:39 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:11:39 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.304s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:11:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:11:46 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:11:47 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Flow 'volume_create_manager' (bb13652f-3bd1-452e-87ce-dbd3fab78b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36aed05-3340-474f-9d92-3f009896e400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36aed05-3340-474f-9d92-3f009896e400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1676934994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b483e1c-88b1-455a-96e4-cebefef8a08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6024bbd2364e2098b90f24d5ca7e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:04Z,use_quota=True,user_id='699e797465164284a7c554d23d84a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91e44f4-4dc4-41ce-afe8-91b948ff9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91e44f4-4dc4-41ce-afe8-91b948ff9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d326041a-045a-4554-b257-9da4fb929c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:04 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d326041a-045a-4554-b257-9da4fb929c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b483e1c-88b1-455a-96e4-cebefef8a08d', 'volume_name': 'volume-7b483e1c-88b1-455a-96e4-cebefef8a08d', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a106e4-888f-4c21-9c76-dc3fb7c3b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a106e4-888f-4c21-9c76-dc3fb7c3b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e85eb38-9fce-41c5-a6f1-51df2bb6cfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Volume 7b483e1c-88b1-455a-96e4-cebefef8a08d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b483e1c-88b1-455a-96e4-cebefef8a08d', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Trying to clone 7b483e1c-88b1-455a-96e4-cebefef8a08d from image a5728ae6-576a-47f4-a55c-199ed63578be at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:12:05 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Image download 20.69 MB at 20.69 MB/s Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[141ceae2-111d-4316-ac38-cdaccba688e8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:06 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD Nov 05 15:12:06 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:06 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be is fetched for user 699e797465164284a7c554d23d84a0d5. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[324ac3ee-6f0d-4328-ad71-815f5514d1b2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:06 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD Nov 05 15:12:06 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:06 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1676934994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b483e1c-88b1-455a-96e4-cebefef8a08d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6024bbd2364e2098b90f24d5ca7e73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:04Z,use_quota=True,user_id='699e797465164284a7c554d23d84a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Creating volume 7b483e1c-88b1-455a-96e4-cebefef8a08d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:12:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:12:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:07 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d 1073741824 Nov 05 15:12:07 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:07 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d 1073741824" returned: 0 in 0.501s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:07 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d Nov 05 15:12:07 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:07 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Attempting download of a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume 7b483e1c-88b1-455a-96e4-cebefef8a08d. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc7c7a-5753-474a-a38e-6160dee37095]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:07 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t Nov 05 15:12:07 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:08 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t" returned: 0 in 0.351s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:08 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t Nov 05 15:12:08 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:08 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t" returned: 1 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_gqugmj_t' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c915c-e35b-4564-b119-864faf5b540f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:08 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD Nov 05 15:12:08 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:08 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] a5728ae6-576a-47f4-a55c-199ed63578be was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:12:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:08 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d Nov 05 15:12:08 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:11 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d" returned: 0 in 2.050s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_raxcsid5devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:12:11 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Converted 112.00 MB image at 54.59 MB/s Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:11 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d 1G Nov 05 15:12:11 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:11 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d 1G" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Downloaded image a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume 7b483e1c-88b1-455a-96e4-cebefef8a08d successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be for user 699e797465164284a7c554d23d84a0d5 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Marking volume 7b483e1c-88b1-455a-96e4-cebefef8a08d as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Copying metadata from image a5728ae6-576a-47f4-a55c-199ed63578be to 7b483e1c-88b1-455a-96e4-cebefef8a08d. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Creating volume glance metadata for volume 7b483e1c-88b1-455a-96e4-cebefef8a08d backed by image a5728ae6-576a-47f4-a55c-199ed63578be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e85eb38-9fce-41c5-a6f1-51df2bb6cfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b483e1c-88b1-455a-96e4-cebefef8a08d', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7052ff08-5266-45b9-8214-05009ab4d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Volume volume-7b483e1c-88b1-455a-96e4-cebefef8a08d (7b483e1c-88b1-455a-96e4-cebefef8a08d): created successfully Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7052ff08-5266-45b9-8214-05009ab4d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Flow 'volume_create_manager' (bb13652f-3bd1-452e-87ce-dbd3fab78b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:12:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c5eec5ff-1acf-43c5-927e-3aee243ba31f tempest-TestShelveInstance-2111213825 None] Created volume successfully. Nov 05 15:12:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-d04030b9-5430-4bbc-baf7-8fae4d933f7d req-8fcc5288-9249-4d57-bfac-a4dcd9b1ac1b tempest-TestMinimumBasicScenario-1564171368 None] Terminate volume connection completed successfully. Nov 05 15:12:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-d04030b9-5430-4bbc-baf7-8fae4d933f7d req-8fcc5288-9249-4d57-bfac-a4dcd9b1ac1b tempest-TestMinimumBasicScenario-1564171368 None] Deleting attachment f902ae4a-7ce1-43c2-9720-fdfbc912e66f. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:12:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Acquiring lock "cinder-949f76c4-8aa3-4763-9d2e-1193b288c1a0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Lock "cinder-949f76c4-8aa3-4763-9d2e-1193b288c1a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Acquiring lock "cinder-quobyte-949f76c4-8aa3-4763-9d2e-1193b288c1a0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Lock "cinder-quobyte-949f76c4-8aa3-4763-9d2e-1193b288c1a0" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[799928df-2a31-4ff9-be62-09461cd31224]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:14 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 Nov 05 15:12:14 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:15 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0" returned: 0 in 0.455s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:15 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0 Nov 05 15:12:15 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:15 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-949f76c4-8aa3-4763-9d2e-1193b288c1a0" returned: 0 in 0.469s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Lock "cinder-quobyte-949f76c4-8aa3-4763-9d2e-1193b288c1a0" released by "delete_volume" :: held 1.010s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Created reservations ['873a51c0-7fce-4ccd-981e-1cf6793a31dd', '3b54f8cf-d937-416f-9345-c137777bde76', '715be020-8433-4e4c-ad9a-ce4680ccb5ee', '23007690-a43f-417a-a0d9-402622d798a2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:15 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:15 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-881764b3-0b59-4b49-ae7e-f89a9f9d5d88 req-00e4279e-4c12-48e6-92f8-2bf412f89613 tempest-TestShelveInstance-2111213825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-881764b3-0b59-4b49-ae7e-f89a9f9d5d88 req-00e4279e-4c12-48e6-92f8-2bf412f89613 tempest-TestShelveInstance-2111213825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-881764b3-0b59-4b49-ae7e-f89a9f9d5d88 req-00e4279e-4c12-48e6-92f8-2bf412f89613 tempest-TestShelveInstance-2111213825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-881764b3-0b59-4b49-ae7e-f89a9f9d5d88 req-00e4279e-4c12-48e6-92f8-2bf412f89613 tempest-TestShelveInstance-2111213825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-7b483e1c-88b1-455a-96e4-cebefef8a08d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91975617-d940-4e91-8c8f-07318583c7f0', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:12:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-881764b3-0b59-4b49-ae7e-f89a9f9d5d88 req-00e4279e-4c12-48e6-92f8-2bf412f89613 tempest-TestShelveInstance-2111213825 None] attachment_update completed successfully. Nov 05 15:12:16 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.460s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Deleted volume successfully. Nov 05 15:12:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cb0df089-7d66-49e0-ae65-211a488f38cb tempest-TestMinimumBasicScenario-1564171368 None] Lock "cinder-949f76c4-8aa3-4763-9d2e-1193b288c1a0-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-37ac7b8a-e9f8-44c3-9c75-c79c62ea4bd3 req-bc94e4bb-bdee-447f-9c96-8584b38c975c tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-37ac7b8a-e9f8-44c3-9c75-c79c62ea4bd3 req-bc94e4bb-bdee-447f-9c96-8584b38c975c tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-37ac7b8a-e9f8-44c3-9c75-c79c62ea4bd3 req-bc94e4bb-bdee-447f-9c96-8584b38c975c tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-37ac7b8a-e9f8-44c3-9c75-c79c62ea4bd3 req-bc94e4bb-bdee-447f-9c96-8584b38c975c tempest-TestServerVolumeAttachmentScenario-291438974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-77f3e016-2126-4128-ae2b-fdfe20764a1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a0af283-4546-4015-be90-bce605b9e672', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:12:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-37ac7b8a-e9f8-44c3-9c75-c79c62ea4bd3 req-bc94e4bb-bdee-447f-9c96-8584b38c975c tempest-TestServerVolumeAttachmentScenario-291438974 None] attachment_update completed successfully. Nov 05 15:12:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a08d8623-f10a-438a-bc89-d244b58fe6bd req-7f62e4dc-2197-424d-8994-0bc6e05640eb tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a08d8623-f10a-438a-bc89-d244b58fe6bd req-7f62e4dc-2197-424d-8994-0bc6e05640eb tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-a08d8623-f10a-438a-bc89-d244b58fe6bd req-7f62e4dc-2197-424d-8994-0bc6e05640eb tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-a08d8623-f10a-438a-bc89-d244b58fe6bd req-7f62e4dc-2197-424d-8994-0bc6e05640eb tempest-TestServerVolumeAttachmentScenario-291438974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc971c04-188a-4a66-8877-201eac781792', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:12:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-a08d8623-f10a-438a-bc89-d244b58fe6bd req-7f62e4dc-2197-424d-8994-0bc6e05640eb tempest-TestServerVolumeAttachmentScenario-291438974 None] attachment_update completed successfully. Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Flow 'volume_create_manager' (a826ec62-d777-4507-9ecd-cc3f5018165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ba29e-8fcd-4266-8fdc-9d5b81882496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815ba29e-8fcd-4266-8fdc-9d5b81882496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1526584595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edc0331-113b-482b-a156-de621a6e32aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7e53fdadd249e89b5d89740dbe97c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:28Z,use_quota=True,user_id='4a62f32f7a1945cca4077c173044e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d488ca94-0d40-4df0-af0a-759d6e7a01b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d488ca94-0d40-4df0-af0a-759d6e7a01b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cf2151-d12e-44df-bc3b-f99f10268636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cf2151-d12e-44df-bc3b-f99f10268636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edc0331-113b-482b-a156-de621a6e32aa', 'volume_name': 'volume-5edc0331-113b-482b-a156-de621a6e32aa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb3d440-dcfb-4e3d-87b1-b3b11d4c08f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb3d440-dcfb-4e3d-87b1-b3b11d4c08f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d892b8-b56e-41f7-a32a-e68a39c7b381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Volume 5edc0331-113b-482b-a156-de621a6e32aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edc0331-113b-482b-a156-de621a6e32aa', 'volume_size': 1} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1526584595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5edc0331-113b-482b-a156-de621a6e32aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7e53fdadd249e89b5d89740dbe97c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:28Z,use_quota=True,user_id='4a62f32f7a1945cca4077c173044e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Creating volume 5edc0331-113b-482b-a156-de621a6e32aa {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:12:28 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:28 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa 1073741824 Nov 05 15:12:28 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-ceba1719-4140-42fb-9e1d-c18b9aa3ee63 req-12b07db4-cfc9-425a-a976-c0e53fa40758 tempest-TestServerVolumeAttachmentScenario-291438974 None] Terminate volume connection completed successfully. Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-ceba1719-4140-42fb-9e1d-c18b9aa3ee63 req-12b07db4-cfc9-425a-a976-c0e53fa40758 tempest-TestServerVolumeAttachmentScenario-291438974 None] Deleting attachment bc971c04-188a-4a66-8877-201eac781792. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:12:28 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa 1073741824" returned: 0 in 0.823s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:29 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa Nov 05 15:12:29 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:29 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa" returned: 0 in 0.411s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d892b8-b56e-41f7-a32a-e68a39c7b381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edc0331-113b-482b-a156-de621a6e32aa', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51244354-91c5-4881-a85d-8d9faf303c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Volume volume-5edc0331-113b-482b-a156-de621a6e32aa (5edc0331-113b-482b-a156-de621a6e32aa): created successfully Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51244354-91c5-4881-a85d-8d9faf303c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Flow 'volume_create_manager' (a826ec62-d777-4507-9ecd-cc3f5018165f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:12:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1e928775-657e-440b-9c17-6398e94e6b5e tempest-AttachVolumeTestJSON-1944887255 None] Created volume successfully. Nov 05 15:12:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-bcfda250-2ab6-4fcd-b6fd-9177482b29f4 req-eb8b59e6-e716-41db-aa86-32f7a863a7e0 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-bcfda250-2ab6-4fcd-b6fd-9177482b29f4 req-eb8b59e6-e716-41db-aa86-32f7a863a7e0 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-8805a144-f1e4-4caf-835c-d5ed6e4078fc req-4138839f-b590-4f85-a774-b9332ea7b781 tempest-TestServerVolumeAttachmentScenario-291438974 None] Terminate volume connection completed successfully. Nov 05 15:12:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8805a144-f1e4-4caf-835c-d5ed6e4078fc req-4138839f-b590-4f85-a774-b9332ea7b781 tempest-TestServerVolumeAttachmentScenario-291438974 None] Deleting attachment 0a0af283-4546-4015-be90-bce605b9e672. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:12:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-bcfda250-2ab6-4fcd-b6fd-9177482b29f4 req-eb8b59e6-e716-41db-aa86-32f7a863a7e0 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-bcfda250-2ab6-4fcd-b6fd-9177482b29f4 req-eb8b59e6-e716-41db-aa86-32f7a863a7e0 tempest-AttachVolumeTestJSON-1944887255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-5edc0331-113b-482b-a156-de621a6e32aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd42f8279-8d17-46cd-bf0b-b1883d860a17', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:12:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-bcfda250-2ab6-4fcd-b6fd-9177482b29f4 req-eb8b59e6-e716-41db-aa86-32f7a863a7e0 tempest-AttachVolumeTestJSON-1944887255 None] attachment_update completed successfully. Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Flow 'volume_create_manager' (dba32764-fc94-48d6-81bc-9fbf3b6c9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ef7507-23d2-422a-9662-eef898bf1585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ef7507-23d2-422a-9662-eef898bf1585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1347244132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167bb1c7-f64f-43a9-b381-412836fca6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7e53fdadd249e89b5d89740dbe97c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:34Z,use_quota=True,user_id='4a62f32f7a1945cca4077c173044e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a43f68f-879c-48bc-abb3-cd1cc3f5e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a43f68f-879c-48bc-abb3-cd1cc3f5e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48348648-3b08-4e2f-afc7-2f16b5d26c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48348648-3b08-4e2f-afc7-2f16b5d26c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167bb1c7-f64f-43a9-b381-412836fca6d0', 'volume_name': 'volume-167bb1c7-f64f-43a9-b381-412836fca6d0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf8d046-ea93-4c4f-b2a6-30d78c9dcaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf8d046-ea93-4c4f-b2a6-30d78c9dcaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4480e-61b9-4cdf-a013-a7e64f80c4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Volume 167bb1c7-f64f-43a9-b381-412836fca6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167bb1c7-f64f-43a9-b381-412836fca6d0', 'volume_size': 1} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1347244132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167bb1c7-f64f-43a9-b381-412836fca6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd7e53fdadd249e89b5d89740dbe97c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:12:34Z,use_quota=True,user_id='4a62f32f7a1945cca4077c173044e860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Creating volume 167bb1c7-f64f-43a9-b381-412836fca6d0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:12:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:34 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 1073741824 Nov 05 15:12:34 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:34 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 1073741824" returned: 0 in 0.535s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:34 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 Nov 05 15:12:34 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:35 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0" returned: 0 in 0.327s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4480e-61b9-4cdf-a013-a7e64f80c4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167bb1c7-f64f-43a9-b381-412836fca6d0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4a7ec4-1d74-4c8b-bc4a-87ff1a3972c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:12:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Volume volume-167bb1c7-f64f-43a9-b381-412836fca6d0 (167bb1c7-f64f-43a9-b381-412836fca6d0): created successfully Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4a7ec4-1d74-4c8b-bc4a-87ff1a3972c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:12:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Flow 'volume_create_manager' (dba32764-fc94-48d6-81bc-9fbf3b6c9a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:12:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-48faba98-8437-4651-8122-59fbdecab4f3 tempest-AttachVolumeTestJSON-1944887255 None] Created volume successfully. Nov 05 15:12:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-de05aa18-76c2-4b39-a852-f06b68f57a2d req-629c51cf-e69f-4bce-9f09-514106f481f7 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-de05aa18-76c2-4b39-a852-f06b68f57a2d req-629c51cf-e69f-4bce-9f09-514106f481f7 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-de05aa18-76c2-4b39-a852-f06b68f57a2d req-629c51cf-e69f-4bce-9f09-514106f481f7 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-de05aa18-76c2-4b39-a852-f06b68f57a2d req-629c51cf-e69f-4bce-9f09-514106f481f7 tempest-AttachVolumeTestJSON-1944887255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-167bb1c7-f64f-43a9-b381-412836fca6d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6973ac54-b35b-486c-9d27-7783cc813cdd', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:12:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-de05aa18-76c2-4b39-a852-f06b68f57a2d req-629c51cf-e69f-4bce-9f09-514106f481f7 tempest-AttachVolumeTestJSON-1944887255 None] attachment_update completed successfully. Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "cinder-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "cinder-quobyte-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-quobyte-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d38ed1-6fc8-48ca-92e7-f4649d7687d8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:38 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 Nov 05 15:12:38 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:38 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10" returned: 0 in 0.466s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:39 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10 Nov 05 15:12:39 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:39 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:39 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:39 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-quobyte-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10" released by "delete_volume" :: held 0.896s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:39 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Created reservations ['46b2ffc4-ec14-486f-b0de-579bede0e719', '54a7741e-b929-4fa1-9376-b089f2803381', '6f917c9d-563c-4f78-9fef-6c99181a1466', '191c4d1f-bce8-4a5d-ba93-112ce9d82627'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:39 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:39 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:39 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Deleted volume successfully. Nov 05 15:12:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1c79fd4c-ea2c-4543-b49a-c18219474cc4 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-f84ae9d8-f30b-4b45-81e7-6534b6a7ab10-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-f483cd3b-6618-4cc3-8b9e-b7d07f9acb05 req-1747e5e7-2db2-4e8f-a2ba-5bc2ae486859 tempest-AttachVolumeTestJSON-1944887255 None] Terminate volume connection completed successfully. Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-f483cd3b-6618-4cc3-8b9e-b7d07f9acb05 req-1747e5e7-2db2-4e8f-a2ba-5bc2ae486859 tempest-AttachVolumeTestJSON-1944887255 None] Deleting attachment d42f8279-8d17-46cd-bf0b-b1883d860a17. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "cinder-77f3e016-2126-4128-ae2b-fdfe20764a1e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-77f3e016-2126-4128-ae2b-fdfe20764a1e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "cinder-quobyte-77f3e016-2126-4128-ae2b-fdfe20764a1e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-quobyte-77f3e016-2126-4128-ae2b-fdfe20764a1e" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99d8554-3e81-49a3-8194-fc889379560d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:41 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e Nov 05 15:12:41 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:41 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:41 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e Nov 05 15:12:41 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:41 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-77f3e016-2126-4128-ae2b-fdfe20764a1e" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-quobyte-77f3e016-2126-4128-ae2b-fdfe20764a1e" released by "delete_volume" :: held 0.852s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Created reservations ['0a6844f6-11cf-4626-a3cd-cb71d6983e54', 'fb25af52-0484-4021-9f9c-d05feeb297cb', 'd9418e8e-2241-4a76-af0e-16c1a4dd2c9d', 'f2639f5f-24cd-4c62-a0ba-565b4c6f4299'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:41 devstack sudo[100232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:41 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-440ac705-71ee-4564-a2bc-7ed2f5ff19e2 req-f83dc34d-a842-4235-984d-3d3d5239753d tempest-AttachVolumeTestJSON-1944887255 None] Terminate volume connection completed successfully. Nov 05 15:12:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-440ac705-71ee-4564-a2bc-7ed2f5ff19e2 req-f83dc34d-a842-4235-984d-3d3d5239753d tempest-AttachVolumeTestJSON-1944887255 None] Deleting attachment 6973ac54-b35b-486c-9d27-7783cc813cdd. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:12:42 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:42 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Deleted volume successfully. Nov 05 15:12:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-84eade41-a4ce-41db-98cc-13b13b91f1f3 tempest-TestServerVolumeAttachmentScenario-291438974 None] Lock "cinder-77f3e016-2126-4128-ae2b-fdfe20764a1e-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:51 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=49,cinder:SELECT=67,cinder:INSERT=16,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:12:52 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=66,cinder:UPDATE=36,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:12:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "cinder-167bb1c7-f64f-43a9-b381-412836fca6d0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-167bb1c7-f64f-43a9-b381-412836fca6d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "cinder-quobyte-167bb1c7-f64f-43a9-b381-412836fca6d0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-quobyte-167bb1c7-f64f-43a9-b381-412836fca6d0" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f88e0f-6611-4ace-b6c1-842f56d83926]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:54 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 Nov 05 15:12:54 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:55 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0" returned: 0 in 0.517s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:55 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0 Nov 05 15:12:55 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:55 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-167bb1c7-f64f-43a9-b381-412836fca6d0" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-quobyte-167bb1c7-f64f-43a9-b381-412836fca6d0" released by "delete_volume" :: held 0.895s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Created reservations ['2c328526-6c4b-4a88-9623-368a03ea81b6', '91303a99-eb55-41cc-a4cb-b65e090ca2f1', '632e2157-d244-4392-85c0-2b6775c57f64', 'a80822a8-50f1-4d46-8a5a-20d7c22e7057'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:55 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:55 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "cinder-5edc0331-113b-482b-a156-de621a6e32aa-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-5edc0331-113b-482b-a156-de621a6e32aa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "cinder-quobyte-5edc0331-113b-482b-a156-de621a6e32aa" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-quobyte-5edc0331-113b-482b-a156-de621a6e32aa" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c2f6c-9dcd-4d49-a6b3-50505d3df8dd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:55 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Deleted volume successfully. Nov 05 15:12:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-04e8faa0-561a-40e0-a804-0ec9622660b6 tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-167bb1c7-f64f-43a9-b381-412836fca6d0-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:55 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa Nov 05 15:12:55 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:56 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa" returned: 0 in 0.508s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:56 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa Nov 05 15:12:56 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:56 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5edc0331-113b-482b-a156-de621a6e32aa" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-quobyte-5edc0331-113b-482b-a156-de621a6e32aa" released by "delete_volume" :: held 0.863s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Created reservations ['e889442f-3e47-49bd-a394-a43405b12e1f', '99222843-7914-41ac-a795-4c1feb0adb1b', 'aae1b499-5c04-4f8a-8208-36d03e9e4e9b', 'cf593e50-bd55-49fb-9142-b5b6f7a3afb2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:56 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:56 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "cinder-3c052378-367e-43ae-821f-2ec3ba32f2e4-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-3c052378-367e-43ae-821f-2ec3ba32f2e4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:57 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Deleted volume successfully. Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "cinder-quobyte-3c052378-367e-43ae-821f-2ec3ba32f2e4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e29699-f852-4d94-b9c6-0cf30d16bf1f tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-5edc0331-113b-482b-a156-de621a6e32aa-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-quobyte-3c052378-367e-43ae-821f-2ec3ba32f2e4" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b2436a-b287-4c47-a420-ac020b3d4b1a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:57 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 Nov 05 15:12:57 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:57 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4" returned: 0 in 0.489s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:57 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4 Nov 05 15:12:57 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:58 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c052378-367e-43ae-821f-2ec3ba32f2e4" returned: 0 in 0.319s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-quobyte-3c052378-367e-43ae-821f-2ec3ba32f2e4" released by "delete_volume" :: held 0.893s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Created reservations ['83688c4b-2793-4460-9234-ae642d106ea0', '8fb8fc4a-c69f-4c36-bfd6-05fe6b4790ab', 'abea51ad-21d2-4481-99de-ac05ee0a186c', '01f77317-7621-4699-bea5-42e6379520a9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:12:58 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:12:58 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:12:58 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:12:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Deleted volume successfully. Nov 05 15:12:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f4fb8483-c02e-40e8-a76d-5b91e5066ace tempest-AttachVolumeTestJSON-1944887255 None] Lock "cinder-3c052378-367e-43ae-821f-2ec3ba32f2e4-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:12:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-d8d0b9e8-2150-4e26-928f-1cd3b74cfb18 req-f840ed60-fa70-4697-accc-4a5165a2f934 tempest-TestShelveInstance-2111213825 None] Terminate volume connection completed successfully. Nov 05 15:12:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-d8d0b9e8-2150-4e26-928f-1cd3b74cfb18 req-f840ed60-fa70-4697-accc-4a5165a2f934 tempest-TestShelveInstance-2111213825 None] Deleting attachment 91975617-d940-4e91-8c8f-07318583c7f0. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:13:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6c3eb8b4-b604-47a5-99d3-130e2a0bf81d req-65678282-6261-4122-baa1-30d89fb3afa4 tempest-TestShelveInstance-2111213825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:13:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6c3eb8b4-b604-47a5-99d3-130e2a0bf81d req-65678282-6261-4122-baa1-30d89fb3afa4 tempest-TestShelveInstance-2111213825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:13:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6c3eb8b4-b604-47a5-99d3-130e2a0bf81d req-65678282-6261-4122-baa1-30d89fb3afa4 tempest-TestShelveInstance-2111213825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:13:08 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6c3eb8b4-b604-47a5-99d3-130e2a0bf81d req-65678282-6261-4122-baa1-30d89fb3afa4 tempest-TestShelveInstance-2111213825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-7b483e1c-88b1-455a-96e4-cebefef8a08d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c738a03e-953a-4761-8716-fbee5f59fa57', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:13:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-6c3eb8b4-b604-47a5-99d3-130e2a0bf81d req-65678282-6261-4122-baa1-30d89fb3afa4 tempest-TestShelveInstance-2111213825 None] attachment_update completed successfully. Nov 05 15:13:18 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=18,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:13:18 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=21,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:39 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:13:39 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:39 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.687s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:13:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:13:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Flow 'volume_create_manager' (322782f3-d198-49c7-a4fb-a5a68ff60711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1703a4e2-9ed7-43e7-9ef6-8eb1e2cbb0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1703a4e2-9ed7-43e7-9ef6-8eb1e2cbb0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1623465060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b18b88-870d-4c8b-b505-0ce51d760a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca4e8007e7f439299b34cd163c5bf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:41Z,use_quota=True,user_id='73518c4ca5cd4677be1dc832ea8e30ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed15e93-8f1e-4d47-b3e0-5cb592b531e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed15e93-8f1e-4d47-b3e0-5cb592b531e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30675640-06ea-4be8-b3f9-26218875e78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30675640-06ea-4be8-b3f9-26218875e78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b18b88-870d-4c8b-b505-0ce51d760a13', 'volume_name': 'volume-19b18b88-870d-4c8b-b505-0ce51d760a13', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a430358-72a8-4664-8459-7030b218c305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a430358-72a8-4664-8459-7030b218c305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c230bf5f-1b38-4538-89dd-28ae6ebddb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:13:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Volume 19b18b88-870d-4c8b-b505-0ce51d760a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b18b88-870d-4c8b-b505-0ce51d760a13', 'volume_size': 1} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1623465060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b18b88-870d-4c8b-b505-0ce51d760a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca4e8007e7f439299b34cd163c5bf71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:13:41Z,use_quota=True,user_id='73518c4ca5cd4677be1dc832ea8e30ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Creating volume 19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:13:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:41 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 1073741824 Nov 05 15:13:41 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:41 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 1073741824" returned: 0 in 0.824s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:42 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 Nov 05 15:13:42 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:42 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13" returned: 0 in 0.454s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c230bf5f-1b38-4538-89dd-28ae6ebddb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b18b88-870d-4c8b-b505-0ce51d760a13', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805550dd-be2c-4df4-8df4-b599e9539397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:13:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Volume volume-19b18b88-870d-4c8b-b505-0ce51d760a13 (19b18b88-870d-4c8b-b505-0ce51d760a13): created successfully Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805550dd-be2c-4df4-8df4-b599e9539397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:13:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Flow 'volume_create_manager' (322782f3-d198-49c7-a4fb-a5a68ff60711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:13:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ec77650-549b-40d1-afd5-127f792f89b6 tempest-TestImageHashVerification-866329017 None] Created volume successfully. Nov 05 15:13:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:13:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:13:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[30429968-51df-49c7-8334-e8fe1229d8fd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:13:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:45 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 Nov 05 15:13:45 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:45 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13" returned: 0 in 0.747s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bf94f3-b236-40e1-9711-75e7392b390f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:13:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:45 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 Nov 05 15:13:45 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:46 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13" returned: 0 in 0.695s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 /opt/stack/data/cinder/conversion/19b18b88-870d-4c8b-b505-0ce51d760a13.temp_image.537da95d-9b2d-4dcc-9692-6f77c100407ddzyb5w73.img {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:46 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 /opt/stack/data/cinder/conversion/19b18b88-870d-4c8b-b505-0ce51d760a13.temp_image.537da95d-9b2d-4dcc-9692-6f77c100407ddzyb5w73.img Nov 05 15:13:46 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:52 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:13:54 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:13:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-f64296f8-b7eb-40d0-85f5-30068c1858ef tempest-TestShelveInstance-2111213825 None] Terminate volume connection completed successfully. Nov 05 15:13:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-f64296f8-b7eb-40d0-85f5-30068c1858ef tempest-TestShelveInstance-2111213825 None] Deleting attachment c738a03e-953a-4761-8716-fbee5f59fa57. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:13:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Acquiring lock "cinder-7b483e1c-88b1-455a-96e4-cebefef8a08d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:13:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Lock "cinder-7b483e1c-88b1-455a-96e4-cebefef8a08d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:13:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Acquiring lock "cinder-quobyte-7b483e1c-88b1-455a-96e4-cebefef8a08d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:13:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Lock "cinder-quobyte-7b483e1c-88b1-455a-96e4-cebefef8a08d" acquired by "delete_volume" :: waited 0.047s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:13:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141488b-88b7-405e-b702-f23cc6054753]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:13:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:58 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d Nov 05 15:13:58 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:58 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d" returned: 0 in 1.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:59 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d Nov 05 15:13:59 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:59 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b483e1c-88b1-455a-96e4-cebefef8a08d" returned: 0 in 0.438s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Lock "cinder-quobyte-7b483e1c-88b1-455a-96e4-cebefef8a08d" released by "delete_volume" :: held 2.010s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG cinder.quota [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Created reservations ['67e9f9b8-a430-4fba-90b6-446fcfc067b6', '98aa9253-4e64-435b-8240-9e8545ede2f7', '98255774-a388-48cb-ae84-14ac64230158', '06b6cfc8-5a92-4aa4-9288-f8d31393c1da'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:13:59 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 /opt/stack/data/cinder/conversion/19b18b88-870d-4c8b-b505-0ce51d760a13.temp_image.537da95d-9b2d-4dcc-9692-6f77c100407ddzyb5w73.img" returned: 0 in 13.193s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e45c487-ac6a-4145-92f4-368ed3f029dd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:13:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:13:59 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:13:59 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:13:59 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 Nov 05 15:13:59 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:00 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:00 devstack cinder-volume[87126]: DEBUG cinder.manager [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Deleted volume successfully. Nov 05 15:14:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [req-51860294-efea-45de-9aa7-fa4cfaedbd14 req-fd115d8a-5737-4cc4-b72b-c3543778c682 tempest-TestShelveInstance-2111213825 None] Lock "cinder-7b483e1c-88b1-455a-96e4-cebefef8a08d-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:00 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13" returned: 0 in 0.723s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:00 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13, size 1024.00 MB, duration 13.20 sec, destination /opt/stack/data/cinder/conversion/19b18b88-870d-4c8b-b505-0ce51d760a13.temp_image.537da95d-9b2d-4dcc-9692-6f77c100407ddzyb5w73.img {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:14:00 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Converted 1024.00 MB image at 77.59 MB/s Nov 05 15:14:00 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] 537da95d-9b2d-4dcc-9692-6f77c100407d was raw, no need to convert to raw {{(pid=87126) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Flow 'volume_create_manager' (4eca5c7b-bca5-4ee4-890f-2c02e2bd5340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8208bc6-7618-4aa8-917f-5928cd4e4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8208bc6-7618-4aa8-917f-5928cd4e4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1113933215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec2a0af2dd34bb697b791d068b730f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:04Z,use_quota=True,user_id='328925bd85b94fceb5b698f37c5f2445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60454250-26e9-462b-ad12-17eeb9ba1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60454250-26e9-462b-ad12-17eeb9ba1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba3116f-38bd-4b8a-b4fd-ede7e28bfb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba3116f-38bd-4b8a-b4fd-ede7e28bfb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b', 'volume_name': 'volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a32975-8c9c-4cf2-8154-86f8827c8842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8a32975-8c9c-4cf2-8154-86f8827c8842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b5f390-be93-4e9e-b03e-d5d9f7676e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Volume 2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b', 'volume_size': 1} Nov 05 15:14:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Flow 'volume_create_manager' (a34a6fa5-ab6a-44c5-a8af-4e24b926f65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb77aeee-3a9c-479e-8f80-7eb4275b83bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb77aeee-3a9c-479e-8f80-7eb4275b83bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1966966120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8042ce-46c1-4134-b180-4506114e638f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d63c710d1b43cfa74d5e4ab06d9e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:13Z,use_quota=True,user_id='7560240fbb5c45a6a5a4675ac9deb084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5837c-91a9-4b43-b8c9-c4b716baef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5837c-91a9-4b43-b8c9-c4b716baef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539613dc-1ccf-487d-93f3-4b9b82be1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (539613dc-1ccf-487d-93f3-4b9b82be1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8042ce-46c1-4134-b180-4506114e638f', 'volume_name': 'volume-1c8042ce-46c1-4134-b180-4506114e638f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1880693d-d466-4b5e-96a9-b83ed1445040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1880693d-d466-4b5e-96a9-b83ed1445040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1d6979-da02-4ecd-9b99-a8ffb003605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Volume 1c8042ce-46c1-4134-b180-4506114e638f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8042ce-46c1-4134-b180-4506114e638f', 'volume_size': 1} Nov 05 15:14:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Flow 'volume_create_manager' (f4ca77d0-5593-44cf-af19-adef0faf704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78d0a84-9571-40c9-bbca-b8aabbb44f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f78d0a84-9571-40c9-bbca-b8aabbb44f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413f7194-1424-4f72-9a37-dbc2d874ac02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7892cbd0d2034132bd8810c93979f2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:19Z,use_quota=True,user_id='4571e3743ba84a93824b5f716bdc662f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c5190c7-da9f-49bd-9e76-f0f4fb76a17d),volume_type_id=5c5190c7-da9f-49bd-9e76-f0f4fb76a17d)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b29f881-8d6d-4788-bc74-439d979ab9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b29f881-8d6d-4788-bc74-439d979ab9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a44dcc-31d6-4260-81b5-75f0358ffebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:18 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a44dcc-31d6-4260-81b5-75f0358ffebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '413f7194-1424-4f72-9a37-dbc2d874ac02', 'volume_name': 'volume-413f7194-1424-4f72-9a37-dbc2d874ac02', 'volume_size': 1, 'image_id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a864a69-573b-4e92-90e0-444298a0bab3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2a844af939de0ab82ccefdb6f1566f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7892cbd0d2034132bd8810c93979f2cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a64879c442b08436f00b878629f653dfd58d0060b5461ed81d6c6a7518ae8305d4a35e85cd4243660bbc9ed41809ca2733f8276565401bc3dacd2619fca6834', 'id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a864a69-573b-4e92-90e0-444298a0bab3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81dbe5b-030c-4422-b74f-5cd02de95bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81dbe5b-030c-4422-b74f-5cd02de95bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951eb843-e90e-48c6-9fe2-bd4712abc943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Volume 413f7194-1424-4f72-9a37-dbc2d874ac02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-413f7194-1424-4f72-9a37-dbc2d874ac02', 'volume_size': 1, 'image_id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a864a69-573b-4e92-90e0-444298a0bab3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2a844af939de0ab82ccefdb6f1566f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7892cbd0d2034132bd8810c93979f2cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a64879c442b08436f00b878629f653dfd58d0060b5461ed81d6c6a7518ae8305d4a35e85cd4243660bbc9ed41809ca2733f8276565401bc3dacd2619fca6834', 'id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a864a69-573b-4e92-90e0-444298a0bab3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Trying to clone 413f7194-1424-4f72-9a37-dbc2d874ac02 from image 7a864a69-573b-4e92-90e0-444298a0bab3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7a864a69-573b-4e92-90e0-444298a0bab3', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:14:19 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Image download 0.00 MB at 0.00 MB/s Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cf7037-a991-4509-a6ab-05c05e52072e]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:19 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD Nov 05 15:14:19 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:19 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:19 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD Nov 05 15:14:19 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:20 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Temporary image 7a864a69-573b-4e92-90e0-444298a0bab3 is fetched for user 4571e3743ba84a93824b5f716bdc662f. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3191b-9d7a-4766-94f1-0b62ab44af94]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:20 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD Nov 05 15:14:20 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:20 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:20 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD Nov 05 15:14:20 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:20 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.825s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Uploaded volume to glance image-id: 537da95d-9b2d-4dcc-9692-6f77c100407d. {{(pid=87126) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.606s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1113933215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec2a0af2dd34bb697b791d068b730f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:04Z,use_quota=True,user_id='328925bd85b94fceb5b698f37c5f2445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Creating volume 2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:21 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b 1073741824 Nov 05 15:14:21 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a7b70629-adb8-4993-a954-db71924f6f56 tempest-TestImageHashVerification-866329017 None] Copy volume to image completed successfully. Nov 05 15:14:22 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b 1073741824" returned: 0 in 0.487s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:22 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b Nov 05 15:14:22 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:22 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.366s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1966966120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8042ce-46c1-4134-b180-4506114e638f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d63c710d1b43cfa74d5e4ab06d9e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:13Z,use_quota=True,user_id='7560240fbb5c45a6a5a4675ac9deb084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Creating volume 1c8042ce-46c1-4134-b180-4506114e638f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:22 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:22 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f 1073741824 Nov 05 15:14:22 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8b5f390-be93-4e9e-b03e-d5d9f7676e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65fe310-1cd3-4e25-8bd9-44839160bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Acquiring lock "cinder-19b18b88-870d-4c8b-b505-0ce51d760a13-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Volume volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b (2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b): created successfully Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65fe310-1cd3-4e25-8bd9-44839160bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Flow 'volume_create_manager' (4eca5c7b-bca5-4ee4-890f-2c02e2bd5340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3f52feab-e7ed-48cf-a4e3-6e95745457af tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Created volume successfully. Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Lock "cinder-19b18b88-870d-4c8b-b505-0ce51d760a13-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Acquiring lock "cinder-quobyte-19b18b88-870d-4c8b-b505-0ce51d760a13" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Lock "cinder-quobyte-19b18b88-870d-4c8b-b505-0ce51d760a13" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefcaba-bf1e-4ac1-9717-e8cf1fb828c9]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:22 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 Nov 05 15:14:22 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:23 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f 1073741824" returned: 0 in 0.484s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:23 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f Nov 05 15:14:23 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:23 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:23 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13 Nov 05 15:14:23 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:23 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.458s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413f7194-1424-4f72-9a37-dbc2d874ac02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7892cbd0d2034132bd8810c93979f2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:19Z,use_quota=True,user_id='4571e3743ba84a93824b5f716bdc662f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c5190c7-da9f-49bd-9e76-f0f4fb76a17d),volume_type_id=5c5190c7-da9f-49bd-9e76-f0f4fb76a17d)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Creating volume 413f7194-1424-4f72-9a37-dbc2d874ac02 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1d6979-da02-4ecd-9b99-a8ffb003605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8042ce-46c1-4134-b180-4506114e638f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:23 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 1073741824 Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733b722-8e5c-4f69-a2ba-2426f7cd5273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:23 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Volume volume-1c8042ce-46c1-4134-b180-4506114e638f (1c8042ce-46c1-4134-b180-4506114e638f): created successfully Nov 05 15:14:23 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7733b722-8e5c-4f69-a2ba-2426f7cd5273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Flow 'volume_create_manager' (a34a6fa5-ab6a-44c5-a8af-4e24b926f65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-19b18b88-870d-4c8b-b505-0ce51d760a13" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Lock "cinder-quobyte-19b18b88-870d-4c8b-b505-0ce51d760a13" released by "delete_volume" :: held 0.752s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3d9e1d25-1401-464e-a54b-ef2f23e731ea tempest-AttachVolumeNegativeTest-486724795 None] Created volume successfully. Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Created reservations ['0173db7c-3332-44a4-ae27-c2a08f3e7739', 'a9e7a8d2-ae2c-4d17-bcdc-59a262e5c2b0', '6b144e9d-32a9-4483-8121-6be97d091166', '40f5dfb3-fb17-4356-85b7-db13458823e9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:23 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:23 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:24 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 1073741824" returned: 0 in 0.648s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:24 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Deleted volume successfully. Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-00180102-bacd-42db-9a0c-2ea37316da5c tempest-TestImageHashVerification-866329017 None] Lock "cinder-19b18b88-870d-4c8b-b505-0ce51d760a13-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:24 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 Nov 05 15:14:24 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:24 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Attempting download of 7a864a69-573b-4e92-90e0-444298a0bab3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a864a69-573b-4e92-90e0-444298a0bab3', 'metadata': {}}])) to volume 413f7194-1424-4f72-9a37-dbc2d874ac02. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb97242a-1d10-4c25-9c78-b02dcca07183]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7efcf841-3688-4992-a0e3-97925d2813c2 req-c7c5e08f-c372-4cd3-a147-603d9be4254c tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7efcf841-3688-4992-a0e3-97925d2813c2 req-c7c5e08f-c372-4cd3-a147-603d9be4254c tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7efcf841-3688-4992-a0e3-97925d2813c2 req-c7c5e08f-c372-4cd3-a147-603d9be4254c tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7efcf841-3688-4992-a0e3-97925d2813c2 req-c7c5e08f-c372-4cd3-a147-603d9be4254c tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5130fc8-f575-40cd-a367-ed7675495bd5', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:14:25 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6 Nov 05 15:14:25 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7efcf841-3688-4992-a0e3-97925d2813c2 req-c7c5e08f-c372-4cd3-a147-603d9be4254c tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] attachment_update completed successfully. Nov 05 15:14:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4ee08e28-da6c-4f9d-878f-c61edb45a94c req-38cd794e-6c15-49d1-b324-05178eae3b03 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4ee08e28-da6c-4f9d-878f-c61edb45a94c req-38cd794e-6c15-49d1-b324-05178eae3b03 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-4ee08e28-da6c-4f9d-878f-c61edb45a94c req-38cd794e-6c15-49d1-b324-05178eae3b03 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-4ee08e28-da6c-4f9d-878f-c61edb45a94c req-38cd794e-6c15-49d1-b324-05178eae3b03 tempest-AttachVolumeNegativeTest-486724795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-1c8042ce-46c1-4134-b180-4506114e638f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15e2353e-0999-4003-a24c-1cea7d3bec11', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:14:25 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6" returned: 0 in 0.638s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-4ee08e28-da6c-4f9d-878f-c61edb45a94c req-38cd794e-6c15-49d1-b324-05178eae3b03 tempest-AttachVolumeNegativeTest-486724795 None] attachment_update completed successfully. Nov 05 15:14:25 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6 Nov 05 15:14:25 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:26 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6" returned: 1 in 0.524s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7a864a69-573b-4e92-90e0-444298a0bab3_kfps2cs6' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2955330b-20cf-4021-b19c-73313f06a079]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:26 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD Nov 05 15:14:26 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:26 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:26 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD Nov 05 15:14:26 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:26 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] 7a864a69-573b-4e92-90e0-444298a0bab3 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:14:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:26 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 Nov 05 15:14:26 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:27 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02" returned: 0 in 0.685s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7a864a69-573b-4e92-90e0-444298a0bab3_p4ml47n5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:14:27 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:27 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 1G Nov 05 15:14:27 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:27 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 1G" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Downloaded image 7a864a69-573b-4e92-90e0-444298a0bab3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7a864a69-573b-4e92-90e0-444298a0bab3', 'metadata': {}}])) to volume 413f7194-1424-4f72-9a37-dbc2d874ac02 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Temporary image 7a864a69-573b-4e92-90e0-444298a0bab3 for user 4571e3743ba84a93824b5f716bdc662f is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Marking volume 413f7194-1424-4f72-9a37-dbc2d874ac02 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Copying metadata from image 7a864a69-573b-4e92-90e0-444298a0bab3 to 413f7194-1424-4f72-9a37-dbc2d874ac02. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Creating volume glance metadata for volume 413f7194-1424-4f72-9a37-dbc2d874ac02 backed by image 7a864a69-573b-4e92-90e0-444298a0bab3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b2a844af939de0ab82ccefdb6f1566f4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951eb843-e90e-48c6-9fe2-bd4712abc943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413f7194-1424-4f72-9a37-dbc2d874ac02', 'volume_size': 1, 'image_id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7a864a69-573b-4e92-90e0-444298a0bab3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b2a844af939de0ab82ccefdb6f1566f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7892cbd0d2034132bd8810c93979f2cb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a64879c442b08436f00b878629f653dfd58d0060b5461ed81d6c6a7518ae8305d4a35e85cd4243660bbc9ed41809ca2733f8276565401bc3dacd2619fca6834', 'id': '7a864a69-573b-4e92-90e0-444298a0bab3', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7a864a69-573b-4e92-90e0-444298a0bab3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03895112-83ba-44e5-8727-e1572ded09c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Volume volume-413f7194-1424-4f72-9a37-dbc2d874ac02 (413f7194-1424-4f72-9a37-dbc2d874ac02): created successfully Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03895112-83ba-44e5-8727-e1572ded09c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Flow 'volume_create_manager' (f4ca77d0-5593-44cf-af19-adef0faf704b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-494ad450-c303-467e-99b4-1f84363700f0 tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Created volume successfully. Nov 05 15:14:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-aee89e42-6e38-403f-81c4-8fa026a52cec req-94150103-a8c8-450a-bce4-1412d37e4846 tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Terminate volume connection completed successfully. Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-aee89e42-6e38-403f-81c4-8fa026a52cec req-94150103-a8c8-450a-bce4-1412d37e4846 tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Deleting attachment b5130fc8-f575-40cd-a367-ed7675495bd5. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Acquiring lock "cinder-413f7194-1424-4f72-9a37-dbc2d874ac02-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "cinder-413f7194-1424-4f72-9a37-dbc2d874ac02-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Acquiring lock "cinder-quobyte-413f7194-1424-4f72-9a37-dbc2d874ac02" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "cinder-quobyte-413f7194-1424-4f72-9a37-dbc2d874ac02" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d90e41-6ef4-4628-a07b-885e2fc13082]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:28 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 Nov 05 15:14:28 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Acquiring lock "cinder-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "cinder-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Acquiring lock "cinder-quobyte-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "cinder-quobyte-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec5716-57fe-487e-b6ac-51dab0c0bd88]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:29 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02" returned: 0 in 0.554s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:29 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02 Nov 05 15:14:29 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:29 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b Nov 05 15:14:29 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:29 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-413f7194-1424-4f72-9a37-dbc2d874ac02" returned: 0 in 0.333s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "cinder-quobyte-413f7194-1424-4f72-9a37-dbc2d874ac02" released by "delete_volume" :: held 1.018s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:29 devstack cinder-volume[87126]: WARNING cinder.quota [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:14:29 devstack cinder-volume[87126]: WARNING cinder.quota [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Created reservations ['2c090537-c460-4b4b-b73a-9c33b5791770', 'ac52f83a-0dc1-4d00-b9a2-4c3d3a8353b3', '2d5f5879-9fa3-4c0a-bb4b-98755f373a79', '9ae708b8-bea5-4805-a5b4-236dcde49281'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:29 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b" returned: 0 in 0.599s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:29 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b Nov 05 15:14:29 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:30 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:30 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:30 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "cinder-quobyte-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b" released by "delete_volume" :: held 1.030s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:30 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Deleted volume successfully. Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d5d1d82d-8146-4f46-ad00-f7f53c0bd20b tempest-VolumeAndVolumeTypeFromImageTest-2033240872 None] Lock "cinder-413f7194-1424-4f72-9a37-dbc2d874ac02-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Created reservations ['1fc27eda-e334-434a-aec7-6926b9912992', 'd91df8d1-b887-4732-84dc-54da430c7752', 'cd98a8fb-7791-4f1a-8a45-5236d92036d9', 'eb7752b6-6a37-4f73-aaf7-a46962ca6bd4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:30 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:30 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:30 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Deleted volume successfully. Nov 05 15:14:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4aef303d-fef7-418b-84de-391a8c5b8e4f tempest-TestServerVolumeAttachScenarioOldVersion-1791003428 None] Lock "cinder-2a98c462-dc4b-44fc-aeef-6f0e3f2ff29b-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:39 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:39 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (ddc46934-fb85-4ce3-88f8-671c072dd428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457db24-2b1d-4b9f-a6eb-6dec13851e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457db24-2b1d-4b9f-a6eb-6dec13851e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1114755894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcc9eb3-b230-490a-a581-cdc968d962ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:39Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5d6c6f-aa10-458e-9eee-d57301bb7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5d6c6f-aa10-458e-9eee-d57301bb7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f9811-b698-487f-ad62-f01ff3550b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666f9811-b698-487f-ad62-f01ff3550b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcc9eb3-b230-490a-a581-cdc968d962ff', 'volume_name': 'volume-2bcc9eb3-b230-490a-a581-cdc968d962ff', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732f135a-9d09-474a-9571-80bf0cd4b30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732f135a-9d09-474a-9571-80bf0cd4b30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a554776-3129-4d0e-a8cc-daa546130b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume 2bcc9eb3-b230-490a-a581-cdc968d962ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcc9eb3-b230-490a-a581-cdc968d962ff', 'volume_size': 1} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1114755894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcc9eb3-b230-490a-a581-cdc968d962ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:39Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating volume 2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:39 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.477s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:14:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:14:39 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff 1073741824 Nov 05 15:14:39 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:40 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff 1073741824" returned: 0 in 0.689s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:40 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff Nov 05 15:14:40 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:41 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff" returned: 0 in 0.715s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a554776-3129-4d0e-a8cc-daa546130b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcc9eb3-b230-490a-a581-cdc968d962ff', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8fbac2-3009-4586-b740-5f35a0045bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume volume-2bcc9eb3-b230-490a-a581-cdc968d962ff (2bcc9eb3-b230-490a-a581-cdc968d962ff): created successfully Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8fbac2-3009-4586-b740-5f35a0045bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (ddc46934-fb85-4ce3-88f8-671c072dd428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-17947c96-7c5f-4eda-9d78-b45df1fc10b1 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created volume successfully. Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating offline snapshot 3130e1c4-5868-462f-9455-db121e3b9721 of volume 2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[07710d7d-32c3-45c4-9368-8ccfc48fc524]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:42 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff Nov 05 15:14:42 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:42 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff" returned: 0 in 0.555s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:42 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 1G Nov 05 15:14:42 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:43 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 1G" returned: 0 in 0.595s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcc9eb3-b230-490a-a581-cdc968d962ff -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:43 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcc9eb3-b230-490a-a581-cdc968d962ff -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 Nov 05 15:14:43 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:43 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcc9eb3-b230-490a-a581-cdc968d962ff -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721" returned: 0 in 0.542s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:43 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 is being set with open permissions: ugo+rw Nov 05 15:14:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:43 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 Nov 05 15:14:43 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:44 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721" returned: 0 in 0.520s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:44 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info Nov 05 15:14:44 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:44 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info" returned: 0 in 0.466s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:44 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info is being set with open permissions: ugo+rw Nov 05 15:14:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:44 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info Nov 05 15:14:44 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:45 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.info" returned: 0 in 0.465s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.302s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a4a74712-4a16-4d7b-94f5-4d095c383527 tempest-CreateVolumesFromSnapshotTest-997239009 None] Create snapshot completed successfully Nov 05 15:14:46 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (0c462a81-0685-4cdd-9a12-e1668f42ba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccab620-d0dd-406b-bfed-c812a12923fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccab620-d0dd-406b-bfed-c812a12923fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-161748507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b26c72e-290d-4d2b-9e15-0c57654aacaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:47Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d92abbc-7c5c-4e6f-af40-c9cc16d12448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d92abbc-7c5c-4e6f-af40-c9cc16d12448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726911b6-7fc6-444f-a00f-253368b38168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726911b6-7fc6-444f-a00f-253368b38168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b26c72e-290d-4d2b-9e15-0c57654aacaf', 'volume_name': 'volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61722419-c7f6-4473-bbb9-89d9c4ae5e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61722419-c7f6-4473-bbb9-89d9c4ae5e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d004ac5-b873-4065-b644-9dbdefd3a218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume 6b26c72e-290d-4d2b-9e15-0c57654aacaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf', 'volume_size': 1} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-161748507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b26c72e-290d-4d2b-9e15-0c57654aacaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:47Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating volume 6b26c72e-290d-4d2b-9e15-0c57654aacaf {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:47 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:47 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf 1073741824 Nov 05 15:14:47 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Flow 'volume_create_manager' (70988895-4eb2-4e88-b489-2fdb62bfb2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39a2446-8aab-4bce-9e19-7500e2eaa39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39a2446-8aab-4bce-9e19-7500e2eaa39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd454131-fb60-477a-adef-2ed2da24eaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82efbc68be014d749168dbaaf4384b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:47Z,use_quota=True,user_id='727a16d039fc40ae8f9607e25d95beb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03d49d5-599b-4b33-8f74-cc0d2add2c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03d49d5-599b-4b33-8f74-cc0d2add2c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa12c6a-8ac9-473c-82a4-9f13bd61f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (cc8f4115-b164-4bb2-b3b5-801bf1d620aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2262a99d-6ebb-4e6b-8f12-8a0eea9a9d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2262a99d-6ebb-4e6b-8f12-8a0eea9a9d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152696495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf2c4ca-7eda-4b71-a692-0f48a0a27ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:48Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73c5e00-5523-4a9e-9af7-0c04b6f221e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73c5e00-5523-4a9e-9af7-0c04b6f221e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff4fa9-fa50-4f19-9a35-220f1f12ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ff4fa9-fa50-4f19-9a35-220f1f12ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf2c4ca-7eda-4b71-a692-0f48a0a27ef7', 'volume_name': 'volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45482c0-3011-470b-9b96-77101b351b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45482c0-3011-470b-9b96-77101b351b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0374114f-67e8-4b8c-b7b7-91af10a1d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume daf2c4ca-7eda-4b71-a692-0f48a0a27ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7', 'volume_size': 1} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa12c6a-8ac9-473c-82a4-9f13bd61f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd454131-fb60-477a-adef-2ed2da24eaf6', 'volume_name': 'volume-fd454131-fb60-477a-adef-2ed2da24eaf6', 'volume_size': 1, 'image_id': '412a7687-dab1-4747-89a6-22be327fd896', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/412a7687-dab1-4747-89a6-22be327fd896', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b65f7ef8740bc69202841402aeea593', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82efbc68be014d749168dbaaf4384b93', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f4a1dc84a2a331a368606d798f4b788d3c49aacb20c934cf50cf0d8f6573bba84a0b908cb46d9ce75d184fdcd8e5b110864e1803b67dcb7ac687d12b4b50779', 'id': '412a7687-dab1-4747-89a6-22be327fd896', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/412a7687-dab1-4747-89a6-22be327fd896/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ff0756-b518-452e-8396-4e9cf7f2b975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ff0756-b518-452e-8396-4e9cf7f2b975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dba404-6a31-4f2a-b38e-9832aebdaad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Volume fd454131-fb60-477a-adef-2ed2da24eaf6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd454131-fb60-477a-adef-2ed2da24eaf6', 'volume_size': 1, 'image_id': '412a7687-dab1-4747-89a6-22be327fd896', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/412a7687-dab1-4747-89a6-22be327fd896', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b65f7ef8740bc69202841402aeea593', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82efbc68be014d749168dbaaf4384b93', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f4a1dc84a2a331a368606d798f4b788d3c49aacb20c934cf50cf0d8f6573bba84a0b908cb46d9ce75d184fdcd8e5b110864e1803b67dcb7ac687d12b4b50779', 'id': '412a7687-dab1-4747-89a6-22be327fd896', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/412a7687-dab1-4747-89a6-22be327fd896/file', 'properties': {}}, 'image_service': } Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Trying to clone fd454131-fb60-477a-adef-2ed2da24eaf6 from image 412a7687-dab1-4747-89a6-22be327fd896 at location (None, [{'url': 'file:///opt/stack/data/glance/images/412a7687-dab1-4747-89a6-22be327fd896', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf 1073741824" returned: 0 in 1.030s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:48 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf Nov 05 15:14:48 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (8b064769-f50f-4261-8b3c-99ba323d1d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1621db09-19f0-4502-9824-d5130987608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Image download 0.00 MB at 0.00 MB/s Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1621db09-19f0-4502-9824-d5130987608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918624972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262526ac-3642-443c-8ba2-45f19dd48af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:48Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6efd194-43e8-465e-a843-b8b404eed620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6efd194-43e8-465e-a843-b8b404eed620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1396ef84-cf19-4c6f-a6bd-9ce0bafc5e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1396ef84-cf19-4c6f-a6bd-9ce0bafc5e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262526ac-3642-443c-8ba2-45f19dd48af6', 'volume_name': 'volume-262526ac-3642-443c-8ba2-45f19dd48af6', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7e19fb-6718-4f97-b353-f678d9765137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7e19fb-6718-4f97-b353-f678d9765137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d78da-a943-4f7a-8674-b46dcf3aadc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume 262526ac-3642-443c-8ba2-45f19dd48af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262526ac-3642-443c-8ba2-45f19dd48af6', 'volume_size': 1} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1d6323-3a7d-4ccb-9c27-2ed1621cc164]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:48 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-152696495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf2c4ca-7eda-4b71-a692-0f48a0a27ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:48Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating volume daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:48 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD Nov 05 15:14:48 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d004ac5-b873-4065-b644-9dbdefd3a218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0cad04-3334-4af9-90f5-214e98e32e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:48 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 1073741824 Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf (6b26c72e-290d-4d2b-9e15-0c57654aacaf): created successfully Nov 05 15:14:48 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b0cad04-3334-4af9-90f5-214e98e32e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (0c462a81-0685-4cdd-9a12-e1668f42ba6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-68a3e6c0-05fd-42ba-bbcd-877ac2e0fcec tempest-CreateVolumesFromSnapshotTest-997239009 None] Created volume successfully. Nov 05 15:14:48 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (d46fc9af-6c7a-4123-ae43-b96fbfa2f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c14ff4f-5aa2-4e62-9b2a-3b10e558e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c14ff4f-5aa2-4e62-9b2a-3b10e558e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1644481709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:49Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936fe204-aae7-4d4a-981f-a801f7aa0134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936fe204-aae7-4d4a-981f-a801f7aa0134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee5deb8-40fd-4881-bf16-38f3c416ca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee5deb8-40fd-4881-bf16-38f3c416ca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a', 'volume_name': 'volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1a4f69-3f04-45d4-afcc-95f6bc0ff7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1a4f69-3f04-45d4-afcc-95f6bc0ff7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8922fd59-a368-44b1-96a8-65fef321e2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a', 'volume_size': 1} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:49 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:49 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD Nov 05 15:14:49 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:14:49 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (5788e05c-d260-42bf-8c7d-58652eefef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05448a9-bc38-495a-8c88-b1b99fb88398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 1073741824" returned: 0 in 1.026s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a05448a9-bc38-495a-8c88-b1b99fb88398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779792308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3ae4c5-ecc9-48de-80ac-518a4d40fa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:50Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef179c3-7cf6-41f1-9652-669b7698265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eef179c3-7cf6-41f1-9652-669b7698265c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fd26a7-b9b8-4746-be6d-6bdeff58cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fd26a7-b9b8-4746-be6d-6bdeff58cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3ae4c5-ecc9-48de-80ac-518a4d40fa86', 'volume_name': 'volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b100f9-e199-4409-906e-6f5c4371423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23b100f9-e199-4409-906e-6f5c4371423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991121d1-4637-4e22-9767-2bc8c84ca0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:49 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume bb3ae4c5-ecc9-48de-80ac-518a4d40fa86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86', 'volume_size': 1} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD" returned: 1 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Temporary image 412a7687-dab1-4747-89a6-22be327fd896 is fetched for user 727a16d039fc40ae8f9607e25d95beb1. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:14:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:50 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 Nov 05 15:14:50 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b57ae3-ef90-4ea0-9b89-eca2cdf4a8a8]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:50 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD Nov 05 15:14:50 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:50 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7" returned: 0 in 0.322s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-918624972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262526ac-3642-443c-8ba2-45f19dd48af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:48Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating volume 262526ac-3642-443c-8ba2-45f19dd48af6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:50 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0374114f-67e8-4b8c-b7b7-91af10a1d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0f9b2-7c31-4779-96ed-1d7a0b814db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:50 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 1073741824 Nov 05 15:14:50 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 (daf2c4ca-7eda-4b71-a692-0f48a0a27ef7): created successfully Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af0f9b2-7c31-4779-96ed-1d7a0b814db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (cc8f4115-b164-4bb2-b3b5-801bf1d620aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e6c24ca4-f30c-4a34-84ba-539990542803 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created volume successfully. Nov 05 15:14:50 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:50 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD Nov 05 15:14:50 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:50 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 1073741824" returned: 0 in 0.527s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:50 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:50 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 Nov 05 15:14:50 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:51 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1644481709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:49Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating volume b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:51 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a20d78da-a943-4f7a-8674-b46dcf3aadc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262526ac-3642-443c-8ba2-45f19dd48af6', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:51 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a 1073741824 Nov 05 15:14:51 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae292e6c-52ec-44a4-b485-372a58d8ae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume volume-262526ac-3642-443c-8ba2-45f19dd48af6 (262526ac-3642-443c-8ba2-45f19dd48af6): created successfully Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae292e6c-52ec-44a4-b485-372a58d8ae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (8b064769-f50f-4261-8b3c-99ba323d1d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8bcc7650-a63a-4f94-a5b7-7f15ceaee40a tempest-CreateVolumesFromSnapshotTest-997239009 None] Created volume successfully. Nov 05 15:14:51 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a 1073741824" returned: 0 in 0.548s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:51 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a Nov 05 15:14:51 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:52 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a" returned: 0 in 0.311s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.184s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1779792308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3ae4c5-ecc9-48de-80ac-518a4d40fa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1872b9b1db214af4bef362ab6c518c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:50Z,use_quota=True,user_id='ef7b972ec684486c95deca74cdb23788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Creating volume bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:52 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8922fd59-a368-44b1-96a8-65fef321e2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:52 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 1073741824 Nov 05 15:14:52 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983144d4-8094-4493-bcf5-aef6bf63efdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:52 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a (b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a): created successfully Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983144d4-8094-4493-bcf5-aef6bf63efdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (d46fc9af-6c7a-4123-ae43-b96fbfa2f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-db52abc3-e9cb-41e0-a8de-bfaf45689c96 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created volume successfully. Nov 05 15:14:52 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 1073741824" returned: 0 in 0.616s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=66,cinder:UPDATE=61,cinder:INSERT=19,cinder:DELETE=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:14:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:52 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 Nov 05 15:14:52 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:53 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86" returned: 0 in 0.325s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd454131-fb60-477a-adef-2ed2da24eaf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82efbc68be014d749168dbaaf4384b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:14:47Z,use_quota=True,user_id='727a16d039fc40ae8f9607e25d95beb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Creating volume fd454131-fb60-477a-adef-2ed2da24eaf6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:14:53 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991121d1-4637-4e22-9767-2bc8c84ca0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:53 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 1073741824 Nov 05 15:14:53 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee0cc09-7f4e-4beb-8fec-bac478b88024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Volume volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 (bb3ae4c5-ecc9-48de-80ac-518a4d40fa86): created successfully Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee0cc09-7f4e-4beb-8fec-bac478b88024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Flow 'volume_create_manager' (5788e05c-d260-42bf-8c7d-58652eefef25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-458f547a-85d9-44e4-bc91-136eeee9f079 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created volume successfully. Nov 05 15:14:53 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 1073741824" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:53 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 Nov 05 15:14:53 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:53 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:53 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Attempting download of 412a7687-dab1-4747-89a6-22be327fd896 ((None, [{'url': 'file:///opt/stack/data/glance/images/412a7687-dab1-4747-89a6-22be327fd896', 'metadata': {}}])) to volume fd454131-fb60-477a-adef-2ed2da24eaf6. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08f60fc-d3c1-4926-8f59-7b85e6077fd5]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_ {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:54 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_ Nov 05 15:14:54 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:54 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_ {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a9385-0710-46fb-9afb-1305ac7ae7e0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:54 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_ Nov 05 15:14:54 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:54 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 Nov 05 15:14:54 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:54 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_" returned: 1 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_412a7687-dab1-4747-89a6-22be327fd896_bb32u6b_' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[162dc3e6-30b6-4061-8f01-945bd344bb4c]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:54 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86" returned: 0 in 0.434s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:54 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86 Nov 05 15:14:54 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:54 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD Nov 05 15:14:54 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:55 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86" released by "delete_volume" :: held 0.780s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:55 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=71,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['d00821f7-5849-47fe-bb02-c95f44fc6886', '71db49e7-aa72-42e1-8187-744e60811247', '4e954847-c110-4651-ae6c-84283370ed57', '88715652-54ec-450b-ac62-b33e72269a9e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:55 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD Nov 05 15:14:55 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:55 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:55 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5aa176-df55-4077-a8ef-77b27d572e80]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:55 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD" returned: 1 in 0.477s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] 412a7687-dab1-4747-89a6-22be327fd896 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:55 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleted volume successfully. Nov 05 15:14:55 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 Nov 05 15:14:55 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-141c3aa9-93c0-4d48-b1fb-c2be3dba5dfd tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-bb3ae4c5-ecc9-48de-80ac-518a4d40fa86-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:55 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a Nov 05 15:14:55 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:56 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:56 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a Nov 05 15:14:56 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:56 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6" returned: 0 in 0.561s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_412a7687-dab1-4747-89a6-22be327fd896_qy_zey5fdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:14:56 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:56 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 1G Nov 05 15:14:56 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:56 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a" returned: 0 in 0.310s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a" released by "delete_volume" :: held 0.825s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['9a666720-a8c7-449a-9dd4-0e9ac4592c4c', '6a38e8f5-05c4-4602-9f22-eaef86957101', '50d406ec-dfb8-41b2-8d21-b2e9a56c3a79', '1946f5c1-5f61-4df2-9e8d-61f6cc477e3f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:56 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:56 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:56 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 1G" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Downloaded image 412a7687-dab1-4747-89a6-22be327fd896 ((None, [{'url': 'file:///opt/stack/data/glance/images/412a7687-dab1-4747-89a6-22be327fd896', 'metadata': {}}])) to volume fd454131-fb60-477a-adef-2ed2da24eaf6 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Temporary image 412a7687-dab1-4747-89a6-22be327fd896 for user 727a16d039fc40ae8f9607e25d95beb1 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Marking volume fd454131-fb60-477a-adef-2ed2da24eaf6 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Copying metadata from image 412a7687-dab1-4747-89a6-22be327fd896 to fd454131-fb60-477a-adef-2ed2da24eaf6. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Creating volume glance metadata for volume fd454131-fb60-477a-adef-2ed2da24eaf6 backed by image 412a7687-dab1-4747-89a6-22be327fd896 with: {'image_id': '412a7687-dab1-4747-89a6-22be327fd896', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6b65f7ef8740bc69202841402aeea593', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8dba404-6a31-4f2a-b38e-9832aebdaad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd454131-fb60-477a-adef-2ed2da24eaf6', 'volume_size': 1, 'image_id': '412a7687-dab1-4747-89a6-22be327fd896', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/412a7687-dab1-4747-89a6-22be327fd896', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b65f7ef8740bc69202841402aeea593', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '82efbc68be014d749168dbaaf4384b93', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f4a1dc84a2a331a368606d798f4b788d3c49aacb20c934cf50cf0d8f6573bba84a0b908cb46d9ce75d184fdcd8e5b110864e1803b67dcb7ac687d12b4b50779', 'id': '412a7687-dab1-4747-89a6-22be327fd896', 'created_at': datetime.datetime(2026, 11, 5, 14, 14, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 14, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/412a7687-dab1-4747-89a6-22be327fd896/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36f5464-99c9-495e-aeb2-e643dbb5e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-262526ac-3642-443c-8ba2-45f19dd48af6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Volume volume-fd454131-fb60-477a-adef-2ed2da24eaf6 (fd454131-fb60-477a-adef-2ed2da24eaf6): created successfully Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36f5464-99c9-495e-aeb2-e643dbb5e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Flow 'volume_create_manager' (70988895-4eb2-4e88-b489-2fdb62bfb2b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-262526ac-3642-443c-8ba2-45f19dd48af6-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fb94c89e-5abb-4c33-a601-260476f1dac4 tempest-VolumeImageDependencyTests-1016399018 None] Created volume successfully. Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-262526ac-3642-443c-8ba2-45f19dd48af6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-262526ac-3642-443c-8ba2-45f19dd48af6" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:56 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96acf6-e1db-4fa8-b1af-96fc2bacb4e6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleted volume successfully. Nov 05 15:14:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-76f86a02-58e1-4118-8697-61a7a6fd2111 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-b7f2bea6-7aaf-4728-9e54-7e140a6f2a8a-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Acquiring lock "cinder-fd454131-fb60-477a-adef-2ed2da24eaf6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:57 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 Nov 05 15:14:57 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Lock "cinder-fd454131-fb60-477a-adef-2ed2da24eaf6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Acquiring lock "cinder-quobyte-fd454131-fb60-477a-adef-2ed2da24eaf6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Lock "cinder-quobyte-fd454131-fb60-477a-adef-2ed2da24eaf6" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbfbc73-5dd2-491b-9c69-6c009c48f3ea]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:57 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 Nov 05 15:14:57 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:57 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6" returned: 0 in 0.482s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:57 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6 Nov 05 15:14:57 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:57 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6" returned: 0 in 0.424s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:57 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-262526ac-3642-443c-8ba2-45f19dd48af6" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:57 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6 Nov 05 15:14:57 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-262526ac-3642-443c-8ba2-45f19dd48af6" released by "delete_volume" :: held 0.818s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['ac9e9ccc-00f0-4e55-aeb6-a0a4184836d6', '417ed731-af96-4dc1-a025-48d8b6a4892f', '21dab3a0-48d5-4a6d-b8f5-652f10c31df2', '1d142667-ded0-495a-99ec-3b1bf9b19780'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:57 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:57 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:57 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fd454131-fb60-477a-adef-2ed2da24eaf6" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Lock "cinder-quobyte-fd454131-fb60-477a-adef-2ed2da24eaf6" released by "delete_volume" :: held 0.779s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Created reservations ['261db177-6cfe-46f8-a126-ef56f10e6057', '28d781e0-532c-4413-a9ce-65f330e4a882', '31e14087-d3fc-48d1-8928-6a3fe86fc7d0', 'b426b57e-df5d-43cd-8930-1fc9ce9e432d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:58 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[038adee3-2b00-40dd-8074-038e2275a288]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleted volume successfully. Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cbf50ae8-d864-4ade-ac2f-798611f88aa2 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-262526ac-3642-443c-8ba2-45f19dd48af6-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:58 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 Nov 05 15:14:58 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:58 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:58 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:58 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7" returned: 0 in 0.441s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:58 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7 Nov 05 15:14:58 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:58 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Deleted volume successfully. Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b39c385d-2377-4c65-9f5e-cdc5b4fdc3ca tempest-VolumeImageDependencyTests-1016399018 None] Lock "cinder-fd454131-fb60-477a-adef-2ed2da24eaf6-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:58 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7" released by "delete_volume" :: held 0.781s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['07fbb703-e48c-4df1-a56d-1c250bbd064d', 'e0554097-fe77-4ba9-924f-068faa56af4e', '1afa6955-7da1-45b0-adcf-90049dcddfd0', '2d5f4525-6060-46cd-b3c4-fa2dd8f00842'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:14:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:59 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:14:59 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-6b26c72e-290d-4d2b-9e15-0c57654aacaf-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-6b26c72e-290d-4d2b-9e15-0c57654aacaf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-6b26c72e-290d-4d2b-9e15-0c57654aacaf" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-6b26c72e-290d-4d2b-9e15-0c57654aacaf" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:14:59 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:14:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleted volume successfully. Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf637504-102b-4754-9d4c-ff382b7e9a62]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e3b64b91-da1a-4c09-995a-a6a907170e82 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-daf2c4ca-7eda-4b71-a692-0f48a0a27ef7-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:14:59 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf Nov 05 15:14:59 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:14:59 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:14:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:14:59 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf Nov 05 15:14:59 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:00 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b26c72e-290d-4d2b-9e15-0c57654aacaf" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-6b26c72e-290d-4d2b-9e15-0c57654aacaf" released by "delete_volume" :: held 0.868s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['f0b47089-a098-47b2-bf8b-e5b177f41fca', 'bdcf193d-2ba0-4575-a6bf-0758fe368891', '7b37d27c-3abc-4afe-8655-76c58a080848', 'bf7badbb-7809-4e19-8da9-9f907c7fe21a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:00 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:00 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-3130e1c4-5868-462f-9455-db121e3b9721-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-3130e1c4-5868-462f-9455-db121e3b9721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-2bcc9eb3-b230-490a-a581-cdc968d962ff" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-2bcc9eb3-b230-490a-a581-cdc968d962ff" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-3130e1c4-5868-462f-9455-db121e3b9721" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-3130e1c4-5868-462f-9455-db121e3b9721" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleting offline snapshot 3130e1c4-5868-462f-9455-db121e3b9721 of volume 2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] snapshot_file for this snap is: volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b27d50-e0e4-4701-b6d4-03a544bfa801]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:00 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleted volume successfully. Nov 05 15:15:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-34666184-7eac-4f50-8d0a-5705c635c6a5 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-6b26c72e-290d-4d2b-9e15-0c57654aacaf-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:00 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 Nov 05 15:15:00 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:01 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721" returned: 0 in 0.499s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bcc9eb3-b230-490a-a581-cdc968d962ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:15:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0845b41d-1485-42db-a13a-b331c059865a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:01 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff Nov 05 15:15:01 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:01 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff" returned: 0 in 0.699s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:01 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 Nov 05 15:15:01 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:02 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721" returned: 0 in 0.519s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:02 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721 Nov 05 15:15:02 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:02 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Flow 'volume_create_manager' (8eea3aaf-f59f-4222-a23b-150cf4edd476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910c8be9-7e17-4b57-94c2-5011ed1b4b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff.3130e1c4-5868-462f-9455-db121e3b9721" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910c8be9-7e17-4b57-94c2-5011ed1b4b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34ed36a-373d-4ed3-9aa7-9f88a35e207c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c10e23ad65549959e6ac26fa5386eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:03Z,use_quota=True,user_id='0a3161848e8b44d295aa0641c36e0721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7afee19-2595-4750-9f01-6d63ab830e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7afee19-2595-4750-9f01-6d63ab830e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3da427-edf4-4eae-9556-dfd6a0998863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3da427-edf4-4eae-9556-dfd6a0998863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34ed36a-373d-4ed3-9aa7-9f88a35e207c', 'volume_name': 'volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea45711-e3fb-454d-817f-728e5b0d76b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea45711-e3fb-454d-817f-728e5b0d76b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5d37d9-70c0-4206-a6d3-90c38990ca1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Volume c34ed36a-373d-4ed3-9aa7-9f88a35e207c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c', 'volume_size': 1} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34ed36a-373d-4ed3-9aa7-9f88a35e207c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c10e23ad65549959e6ac26fa5386eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:03Z,use_quota=True,user_id='0a3161848e8b44d295aa0641c36e0721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Creating volume c34ed36a-373d-4ed3-9aa7-9f88a35e207c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:02 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:02 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c 1073741824 Nov 05 15:15:02 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-3130e1c4-5868-462f-9455-db121e3b9721" released by "_delete_snapshot" :: held 2.365s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-2bcc9eb3-b230-490a-a581-cdc968d962ff" released by "delete_snapshot" :: held 2.402s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:02 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['092dd815-1578-43b2-8e30-960271c561c8', 'fc95e3a4-fa46-4f55-b02d-f8d20b15c609', '594e508e-9c84-4ce4-8f4f-c8607a21449d', 'a74869d5-442b-4772-94a3-87135ec86154'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Delete snapshot completed successfully. Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f586ceda-b5e2-41a0-b9d0-09b2946c8c2a tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-3130e1c4-5868-462f-9455-db121e3b9721-delete_snapshot" released by "delete_snapshot" :: held 2.573s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:03 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c 1073741824" returned: 0 in 0.506s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:03 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c Nov 05 15:15:03 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:03 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5d37d9-70c0-4206-a6d3-90c38990ca1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcbcbcb-8019-4423-bcde-3a4654fceafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:03 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Volume volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c (c34ed36a-373d-4ed3-9aa7-9f88a35e207c): created successfully Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcbcbcb-8019-4423-bcde-3a4654fceafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Flow 'volume_create_manager' (8eea3aaf-f59f-4222-a23b-150cf4edd476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4ecfec00-cd55-4dbc-bf1d-4f24e2482383 tempest-CinderUnicodeTest-134752768 None] Created volume successfully. Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-2bcc9eb3-b230-490a-a581-cdc968d962ff-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-2bcc9eb3-b230-490a-a581-cdc968d962ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "cinder-quobyte-2bcc9eb3-b230-490a-a581-cdc968d962ff" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-2bcc9eb3-b230-490a-a581-cdc968d962ff" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[067869d5-7ae3-499c-b8d8-981645ce29b1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:04 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff Nov 05 15:15:04 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:04 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:04 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff Nov 05 15:15:04 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:04 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2bcc9eb3-b230-490a-a581-cdc968d962ff" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-quobyte-2bcc9eb3-b230-490a-a581-cdc968d962ff" released by "delete_volume" :: held 0.845s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Created reservations ['58b0b346-2f25-4c4e-8b73-a47c7e62a95e', '0238edcd-7b75-459c-9574-927c76eaed83', 'ccb255b0-5d22-453e-aba7-90f45455e50b', '9544e1d0-591f-4150-a1fe-b0db7e2ed13e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:04 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:04 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:05 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Deleted volume successfully. Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f99b54b9-e49b-43a6-852b-033712b0c309 tempest-CreateVolumesFromSnapshotTest-997239009 None] Lock "cinder-2bcc9eb3-b230-490a-a581-cdc968d962ff-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Flow 'volume_create_manager' (a6df20df-08a7-425e-b72f-8814822169fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc5891f-b10b-4a73-b84d-2d27358ef560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cc5891f-b10b-4a73-b84d-2d27358ef560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1788083889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e91074b-4961-4ee2-b0c3-e20665bcd066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c10e23ad65549959e6ac26fa5386eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:06Z,use_quota=True,user_id='0a3161848e8b44d295aa0641c36e0721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192c88cb-c047-4f4d-9676-f3c3c704158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192c88cb-c047-4f4d-9676-f3c3c704158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808dd681-ce7a-4ace-8707-a3d1c70bcfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808dd681-ce7a-4ace-8707-a3d1c70bcfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e91074b-4961-4ee2-b0c3-e20665bcd066', 'volume_name': 'volume-9e91074b-4961-4ee2-b0c3-e20665bcd066', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d48ca3-0810-4c33-8b22-b829cf3bc4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d48ca3-0810-4c33-8b22-b829cf3bc4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31504dc-7c8c-4551-88c5-4516a062152d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Volume 9e91074b-4961-4ee2-b0c3-e20665bcd066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e91074b-4961-4ee2-b0c3-e20665bcd066', 'volume_size': 1} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1788083889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e91074b-4961-4ee2-b0c3-e20665bcd066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c10e23ad65549959e6ac26fa5386eac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:06Z,use_quota=True,user_id='0a3161848e8b44d295aa0641c36e0721',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Creating volume 9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:05 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:05 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 1073741824 Nov 05 15:15:05 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:06 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 1073741824" returned: 0 in 0.600s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:06 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 Nov 05 15:15:06 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:06 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31504dc-7c8c-4551-88c5-4516a062152d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e91074b-4961-4ee2-b0c3-e20665bcd066', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ecc2e8-9397-448f-b887-37a1c70ed19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:06 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Volume volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 (9e91074b-4961-4ee2-b0c3-e20665bcd066): created successfully Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ecc2e8-9397-448f-b887-37a1c70ed19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:06 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Flow 'volume_create_manager' (a6df20df-08a7-425e-b72f-8814822169fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bc475739-846e-4a28-a6e5-a14748dea8bb tempest-CinderUnicodeTest-134752768 None] Created volume successfully. Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Creating offline snapshot dd5bc09e-8357-4a53-ad5d-c81dc3d259ac of volume 9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[02942c54-c32a-49ca-8601-043c57d810cb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:08 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 Nov 05 15:15:08 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:08 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:08 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac 1G Nov 05 15:15:08 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:09 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac 1G" returned: 0 in 0.589s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:09 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac Nov 05 15:15:09 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:09 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" returned: 0 in 0.455s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:09 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac is being set with open permissions: ugo+rw Nov 05 15:15:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:09 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac Nov 05 15:15:09 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:10 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" returned: 0 in 0.325s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:10 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info Nov 05 15:15:10 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:10 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:10 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info is being set with open permissions: ugo+rw Nov 05 15:15:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:10 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info Nov 05 15:15:10 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:11 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.info" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ebadee32-619a-403c-bc54-e4ec3449b6dd tempest-CinderUnicodeTest-134752768 None] Create snapshot completed successfully Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-dd5bc09e-8357-4a53-ad5d-c81dc3d259ac-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-dd5bc09e-8357-4a53-ad5d-c81dc3d259ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-quobyte-9e91074b-4961-4ee2-b0c3-e20665bcd066" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-9e91074b-4961-4ee2-b0c3-e20665bcd066" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-quobyte-dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Deleting offline snapshot dd5bc09e-8357-4a53-ad5d-c81dc3d259ac of volume 9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] snapshot_file for this snap is: volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd5af78-048e-42a3-8c80-184f8c29d168]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:12 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac Nov 05 15:15:12 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (b7e397d3-afb4-4c1b-88bf-e90b2c1e17f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7117d803-2cd7-4b2c-8fbf-4d626fc45052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7117d803-2cd7-4b2c-8fbf-4d626fc45052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753217950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb6265f-a331-4ee8-a4b1-824c2ce345e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:12Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12179a45-3dc5-402a-9616-df131abbe427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12179a45-3dc5-402a-9616-df131abbe427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1091c02e-f6d3-4100-a44a-3ff11c4fbcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1091c02e-f6d3-4100-a44a-3ff11c4fbcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb6265f-a331-4ee8-a4b1-824c2ce345e2', 'volume_name': 'volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6788309-1a9c-47e3-8d57-f363de3d428b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6788309-1a9c-47e3-8d57-f363de3d428b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9485b902-6359-47ff-951c-6a78f1ee74e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume 7bb6265f-a331-4ee8-a4b1-824c2ce345e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2', 'volume_size': 1} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-753217950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb6265f-a331-4ee8-a4b1-824c2ce345e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:12Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Creating volume 7bb6265f-a331-4ee8-a4b1-824c2ce345e2 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:12 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:12 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 1073741824 Nov 05 15:15:12 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:12 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" returned: 0 in 0.648s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e91074b-4961-4ee2-b0c3-e20665bcd066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b0ddb2-c019-493b-8413-dd472143923f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-8d6d8f5b-d188-474a-ac69-6c74dffc05bd req-9f048d86-a8ec-4f1b-8abd-bc1c339e65d0 tempest-AttachVolumeNegativeTest-486724795 None] Terminate volume connection completed successfully. Nov 05 15:15:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-8d6d8f5b-d188-474a-ac69-6c74dffc05bd req-9f048d86-a8ec-4f1b-8abd-bc1c339e65d0 tempest-AttachVolumeNegativeTest-486724795 None] Deleting attachment 15e2353e-0999-4003-a24c-1cea7d3bec11. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:15:12 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 Nov 05 15:15:12 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:13 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 1073741824" returned: 0 in 0.644s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:13 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066" returned: 0 in 0.527s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:13 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:13 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:13 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 Nov 05 15:15:13 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:13 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9485b902-6359-47ff-951c-6a78f1ee74e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfdb807-3b9e-45d1-a0ba-be305bb079e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 (7bb6265f-a331-4ee8-a4b1-824c2ce345e2): created successfully Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfdb807-3b9e-45d1-a0ba-be305bb079e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (b7e397d3-afb4-4c1b-88bf-e90b2c1e17f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-39553fbd-8f15-464a-b07e-908fe1870316 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created volume successfully. Nov 05 15:15:13 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" returned: 0 in 0.537s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:13 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac Nov 05 15:15:13 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:13 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066.dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" returned: 0 in 0.403s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-dd5bc09e-8357-4a53-ad5d-c81dc3d259ac" released by "_delete_snapshot" :: held 2.310s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-9e91074b-4961-4ee2-b0c3-e20665bcd066" released by "delete_snapshot" :: held 2.358s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:14 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Created reservations ['7f7658b7-ed4c-42b0-b24a-05beee4ca4b0', '4cf5c7f1-3084-49f1-a214-530745777a50', 'e29d406e-3c28-4269-aac9-94b2b9180845', '2ff2572e-bec8-4339-99eb-48c69257e702'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Delete snapshot completed successfully. Nov 05 15:15:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d33e6715-52b6-4da3-81f8-4862a3c83c77 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-dd5bc09e-8357-4a53-ad5d-c81dc3d259ac-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:14 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (ab1d0ac3-fa18-4ba8-a69f-4ea1e2458d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544bbe70-4a2c-4b90-bccf-94df2e952047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544bbe70-4a2c-4b90-bccf-94df2e952047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-981154704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a52665-3435-4ec1-8c99-25f433717ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:15Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b5606-e0fd-4f39-9f67-ea6ba39201ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534b5606-e0fd-4f39-9f67-ea6ba39201ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d13684-31bf-433e-bd31-419d4e7e379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d13684-31bf-433e-bd31-419d4e7e379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a52665-3435-4ec1-8c99-25f433717ded', 'volume_name': 'volume-94a52665-3435-4ec1-8c99-25f433717ded', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7b45a-61e2-4448-90cf-fbd8074f9aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e7b45a-61e2-4448-90cf-fbd8074f9aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef565b7a-38f1-4494-a2be-42c9fed2089b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume 94a52665-3435-4ec1-8c99-25f433717ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a52665-3435-4ec1-8c99-25f433717ded', 'volume_size': 1} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-981154704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a52665-3435-4ec1-8c99-25f433717ded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:15Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Creating volume 94a52665-3435-4ec1-8c99-25f433717ded {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-9e91074b-4961-4ee2-b0c3-e20665bcd066-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-9e91074b-4961-4ee2-b0c3-e20665bcd066-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:15 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded 1073741824 Nov 05 15:15:15 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-quobyte-9e91074b-4961-4ee2-b0c3-e20665bcd066" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-9e91074b-4961-4ee2-b0c3-e20665bcd066" acquired by "delete_volume" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[09269f3b-9a56-4974-9c13-8bcfee6c272c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (3ab759c2-7721-4c6f-b544-24797baef6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb6ba11-2405-4775-b3d0-15f4a8307e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb6ba11-2405-4775-b3d0-15f4a8307e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319788098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eddb67-9426-4ffd-969b-88836f776739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:16Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6b431f-670e-4440-96ee-6da338145da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6b431f-670e-4440-96ee-6da338145da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dd8860-8f71-4bfc-94db-2c41ac5d017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36dd8860-8f71-4bfc-94db-2c41ac5d017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1eddb67-9426-4ffd-969b-88836f776739', 'volume_name': 'volume-b1eddb67-9426-4ffd-969b-88836f776739', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39f4c9f-0545-4dd7-ae8a-833fff586ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39f4c9f-0545-4dd7-ae8a-833fff586ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773d0c82-a2bc-49dd-b7c5-9a8758163e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume b1eddb67-9426-4ffd-969b-88836f776739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1eddb67-9426-4ffd-969b-88836f776739', 'volume_size': 1} Nov 05 15:15:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:16 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded 1073741824" returned: 0 in 0.912s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:16 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded Nov 05 15:15:16 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:16 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066" returned: 0 in 0.920s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:16 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066 Nov 05 15:15:16 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (b96c1f6d-738d-4a00-807b-20591abafc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bceaf8e0-4a21-44ea-bd66-9bdeaee0bd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bceaf8e0-4a21-44ea-bd66-9bdeaee0bd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025119934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c73c942-cf00-4fca-b315-39a4e7ff006d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:16Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3646dd2b-c0a6-4ebd-a023-05c34032bcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3646dd2b-c0a6-4ebd-a023-05c34032bcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b31b23-5059-468d-b1e5-e2eaa185cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b31b23-5059-468d-b1e5-e2eaa185cc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c73c942-cf00-4fca-b315-39a4e7ff006d', 'volume_name': 'volume-4c73c942-cf00-4fca-b315-39a4e7ff006d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:16 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30529e4a-5212-4053-8740-3832dd3cd8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30529e4a-5212-4053-8740-3832dd3cd8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9331f6f-e6d3-45b8-ad66-f5c4a8960cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume 4c73c942-cf00-4fca-b315-39a4e7ff006d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c73c942-cf00-4fca-b315-39a4e7ff006d', 'volume_size': 1} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded" returned: 0 in 0.654s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319788098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eddb67-9426-4ffd-969b-88836f776739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:16Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Creating volume b1eddb67-9426-4ffd-969b-88836f776739 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:16 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 1073741824 Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef565b7a-38f1-4494-a2be-42c9fed2089b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a52665-3435-4ec1-8c99-25f433717ded', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:16 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a63132-5ada-486f-94ce-1a8faf65e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume volume-94a52665-3435-4ec1-8c99-25f433717ded (94a52665-3435-4ec1-8c99-25f433717ded): created successfully Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a63132-5ada-486f-94ce-1a8faf65e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (ab1d0ac3-fa18-4ba8-a69f-4ea1e2458d7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5c9d0e1c-4d91-488f-9f91-5387ab3a674c tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created volume successfully. Nov 05 15:15:16 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9e91074b-4961-4ee2-b0c3-e20665bcd066" returned: 0 in 0.601s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-9e91074b-4961-4ee2-b0c3-e20665bcd066" released by "delete_volume" :: held 1.668s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Created reservations ['742518be-d3e3-4d20-8f5f-6dca1996bbe1', '0cc16c4a-3371-408c-b186-da964b3b58d2', '4f7157ee-3258-445b-bc29-e50a745697c8', 'e7d5a956-77fe-4fd6-9256-9b95e22133f2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:17 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:17 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (1fe71584-5532-4991-a134-d6555df5a53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100180d3-54a4-4b39-8447-1d75733f3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (100180d3-54a4-4b39-8447-1d75733f3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972260976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95fbdf9-4f45-4c14-95fc-70b047993af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:17Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfdefae-71b7-42a2-ad03-fa206182cfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfdefae-71b7-42a2-ad03-fa206182cfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bf2fd8-a8a3-42e2-ae1b-c15681dca33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bf2fd8-a8a3-42e2-ae1b-c15681dca33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95fbdf9-4f45-4c14-95fc-70b047993af2', 'volume_name': 'volume-b95fbdf9-4f45-4c14-95fc-70b047993af2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3458e31a-d94a-488a-ae98-2573208b0172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3458e31a-d94a-488a-ae98-2573208b0172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cf433d-6d54-45ed-a9b4-e5b0ad0957dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume b95fbdf9-4f45-4c14-95fc-70b047993af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95fbdf9-4f45-4c14-95fc-70b047993af2', 'volume_size': 1} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:17 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 1073741824" returned: 0 in 0.792s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-c34ed36a-373d-4ed3-9aa7-9f88a35e207c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-c34ed36a-373d-4ed3-9aa7-9f88a35e207c-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:17 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 Nov 05 15:15:17 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:17 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.537s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "cinder-quobyte-c34ed36a-373d-4ed3-9aa7-9f88a35e207c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Deleted volume successfully. Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-c34ed36a-373d-4ed3-9aa7-9f88a35e207c" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-903f3ae6-5a0b-44c1-bf0f-341c84eaa0a5 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-9e91074b-4961-4ee2-b0c3-e20665bcd066-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa59a8e-572a-4637-9b95-d5b3ea83eae6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:18 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (eded6782-085f-471b-9edd-ec329b807424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565e37cc-e78c-42da-bab3-7100a7c6ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025119934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c73c942-cf00-4fca-b315-39a4e7ff006d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:16Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Creating volume 4c73c942-cf00-4fca-b315-39a4e7ff006d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:18 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c Nov 05 15:15:18 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:18 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565e37cc-e78c-42da-bab3-7100a7c6ac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636484752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d95071-8857-464b-bfda-0f08a38b3149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:18Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d104600b-7bac-49b0-a72a-bc23817c90a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d104600b-7bac-49b0-a72a-bc23817c90a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e4619c-05fe-413d-b3a8-ec3e83bff7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:18 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d 1073741824 Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e4619c-05fe-413d-b3a8-ec3e83bff7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d95071-8857-464b-bfda-0f08a38b3149', 'volume_name': 'volume-b9d95071-8857-464b-bfda-0f08a38b3149', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:18 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424f6e76-89e4-4af6-a8cf-1dbd38518048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424f6e76-89e4-4af6-a8cf-1dbd38518048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de4627b-a778-442b-8fb7-9043ea2c2ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume b9d95071-8857-464b-bfda-0f08a38b3149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d95071-8857-464b-bfda-0f08a38b3149', 'volume_size': 1} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773d0c82-a2bc-49dd-b7c5-9a8758163e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1eddb67-9426-4ffd-969b-88836f776739', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d571301-2527-4dd0-91d5-4c210d8b6f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume volume-b1eddb67-9426-4ffd-969b-88836f776739 (b1eddb67-9426-4ffd-969b-88836f776739): created successfully Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d571301-2527-4dd0-91d5-4c210d8b6f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (3ab759c2-7721-4c6f-b544-24797baef6cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1bbb78d4-4ba1-46aa-9572-6994ebd67d87 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created volume successfully. Nov 05 15:15:18 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c" returned: 0 in 0.608s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:18 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c Nov 05 15:15:18 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:18 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d 1073741824" returned: 0 in 0.779s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:18 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c34ed36a-373d-4ed3-9aa7-9f88a35e207c" returned: 0 in 0.426s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-quobyte-c34ed36a-373d-4ed3-9aa7-9f88a35e207c" released by "delete_volume" :: held 1.105s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:19 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d Nov 05 15:15:19 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Created reservations ['360e5a75-1249-447a-b255-f14b75be150b', '4b0a3b3c-2dc1-469e-b5b4-57b559d38adb', '837c3a5e-f330-4fd2-84f0-6d68798f4113', '2b7f69b8-3fa6-4ae1-a828-4dad21b3a156'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:19 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:19 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:19 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d" returned: 0 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.863s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972260976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95fbdf9-4f45-4c14-95fc-70b047993af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:17Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Creating volume b95fbdf9-4f45-4c14-95fc-70b047993af2 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9331f6f-e6d3-45b8-ad66-f5c4a8960cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c73c942-cf00-4fca-b315-39a4e7ff006d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0097876d-d473-4b77-927d-f8b97bfb4a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:19 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 1073741824 Nov 05 15:15:19 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume volume-4c73c942-cf00-4fca-b315-39a4e7ff006d (4c73c942-cf00-4fca-b315-39a4e7ff006d): created successfully Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0097876d-d473-4b77-927d-f8b97bfb4a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (b96c1f6d-738d-4a00-807b-20591abafc13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c71c5177-f57b-4d56-b300-3011247453f2 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created volume successfully. Nov 05 15:15:19 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.340s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Deleted volume successfully. Nov 05 15:15:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f35c142f-4238-45f9-95fe-5a1b487d0e47 tempest-CinderUnicodeTest-134752768 None] Lock "cinder-c34ed36a-373d-4ed3-9aa7-9f88a35e207c-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:20 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 1073741824" returned: 0 in 0.670s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:20 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 Nov 05 15:15:20 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:20 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.265s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-636484752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d95071-8857-464b-bfda-0f08a38b3149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6246eefb00d6498caec4d258a19f651a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:18Z,use_quota=True,user_id='756b75626ea04900b961d1fc7792d1aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Creating volume b9d95071-8857-464b-bfda-0f08a38b3149 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63cf433d-6d54-45ed-a9b4-e5b0ad0957dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95fbdf9-4f45-4c14-95fc-70b047993af2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:20 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 1073741824 Nov 05 15:15:20 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f56498-ccf6-4dfd-986f-9bb4640144a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 (b95fbdf9-4f45-4c14-95fc-70b047993af2): created successfully Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f56498-ccf6-4dfd-986f-9bb4640144a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (1fe71584-5532-4991-a134-d6555df5a53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1c7fafcc-ddd3-468c-a57c-05493b4d331b tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created volume successfully. Nov 05 15:15:21 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 1073741824" returned: 0 in 0.668s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:21 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 Nov 05 15:15:21 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:21 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de4627b-a778-442b-8fb7-9043ea2c2ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d95071-8857-464b-bfda-0f08a38b3149', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5614226-374f-457a-80f4-a4f33230f0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Volume volume-b9d95071-8857-464b-bfda-0f08a38b3149 (b9d95071-8857-464b-bfda-0f08a38b3149): created successfully Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5614226-374f-457a-80f4-a4f33230f0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Flow 'volume_create_manager' (eded6782-085f-471b-9edd-ec329b807424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-013f151e-ce30-484e-836f-6adcd29053e6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created volume successfully. Nov 05 15:15:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-b9d95071-8857-464b-bfda-0f08a38b3149-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-b9d95071-8857-464b-bfda-0f08a38b3149-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-quobyte-b9d95071-8857-464b-bfda-0f08a38b3149" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-b9d95071-8857-464b-bfda-0f08a38b3149" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b61193c-798f-4ec0-a9a1-41c23372710b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:22 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 Nov 05 15:15:22 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:23 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149" returned: 0 in 0.432s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:23 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149 Nov 05 15:15:23 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:23 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9d95071-8857-464b-bfda-0f08a38b3149" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-b9d95071-8857-464b-bfda-0f08a38b3149" released by "delete_volume" :: held 0.849s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created reservations ['148719ed-c955-4ec3-990c-472908eb0bbe', '8899b46f-6a33-4a33-a1eb-a3b37dcba879', '8f749487-79b2-4c0e-8445-9f490d4f661e', '76fef5cf-e7ef-44ab-aac2-6f660d02ffc1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:23 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:23 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-b95fbdf9-4f45-4c14-95fc-70b047993af2-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-b95fbdf9-4f45-4c14-95fc-70b047993af2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-quobyte-b95fbdf9-4f45-4c14-95fc-70b047993af2" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-b95fbdf9-4f45-4c14-95fc-70b047993af2" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb90739e-2b6e-479c-89dc-35a54d87463c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:24 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Deleted volume successfully. Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b70a588c-fd7e-4175-b0f9-a3c05742c3f0 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-b9d95071-8857-464b-bfda-0f08a38b3149-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:24 devstack sudo[102493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 Nov 05 15:15:24 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:24 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2" returned: 0 in 0.568s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:24 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2 Nov 05 15:15:24 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:25 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b95fbdf9-4f45-4c14-95fc-70b047993af2" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-b95fbdf9-4f45-4c14-95fc-70b047993af2" released by "delete_volume" :: held 0.990s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created reservations ['c46c0997-f91b-4047-9d54-6ef5ebd47499', '6fc474eb-212d-4dd1-b9c8-41737e492c3e', '6c68b8f9-272d-4a21-9734-9a646a20b6e4', '65baa5f0-7eef-4cfb-be03-5684b5fcd9ea'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:25 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:25 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:25 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Deleted volume successfully. Nov 05 15:15:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-964ae7b8-4609-4cb7-8838-5a14fde2977e tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-b95fbdf9-4f45-4c14-95fc-70b047993af2-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (95585cf3-1fdc-4194-88cf-befdf494ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc465c0-fe4f-4a70-a8dc-127227f37c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc465c0-fe4f-4a70-a8dc-127227f37c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422256887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d267e4b0-3571-4004-b832-148066ac9b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:26Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12a5f97-830c-4573-b5b5-8c124191cfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12a5f97-830c-4573-b5b5-8c124191cfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97185be9-29a7-4318-aa1b-3186ae3bb371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97185be9-29a7-4318-aa1b-3186ae3bb371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd267e4b0-3571-4004-b832-148066ac9b33', 'volume_name': 'volume-d267e4b0-3571-4004-b832-148066ac9b33', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b38d5ba-bd7f-459f-b02b-38f6a0d1f80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b38d5ba-bd7f-459f-b02b-38f6a0d1f80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16733c7a-cbc9-4d8c-b255-47ec1ddb34f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Volume d267e4b0-3571-4004-b832-148066ac9b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d267e4b0-3571-4004-b832-148066ac9b33', 'volume_size': 1} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422256887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d267e4b0-3571-4004-b832-148066ac9b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:26Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Creating volume d267e4b0-3571-4004-b832-148066ac9b33 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:26 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:26 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 1073741824 Nov 05 15:15:26 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-4c73c942-cf00-4fca-b315-39a4e7ff006d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-4c73c942-cf00-4fca-b315-39a4e7ff006d-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-quobyte-4c73c942-cf00-4fca-b315-39a4e7ff006d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-4c73c942-cf00-4fca-b315-39a4e7ff006d" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba3b50-1a8c-42e2-a7e1-f16ea502193a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:26 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d Nov 05 15:15:26 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:27 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 1073741824" returned: 0 in 0.995s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:27 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d" returned: 0 in 0.637s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:27 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 Nov 05 15:15:27 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:27 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d Nov 05 15:15:27 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:27 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16733c7a-cbc9-4d8c-b255-47ec1ddb34f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d267e4b0-3571-4004-b832-148066ac9b33', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480812b1-a43c-46c9-a315-70df6777ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Volume volume-d267e4b0-3571-4004-b832-148066ac9b33 (d267e4b0-3571-4004-b832-148066ac9b33): created successfully Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480812b1-a43c-46c9-a315-70df6777ed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:27 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (95585cf3-1fdc-4194-88cf-befdf494ba67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4c73c942-cf00-4fca-b315-39a4e7ff006d" returned: 0 in 0.466s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-4c73c942-cf00-4fca-b315-39a4e7ff006d" released by "delete_volume" :: held 1.176s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6b968b95-12bd-4bb9-bdb4-e4580601af11 tempest-ProjectReaderTests-1897515257 None] Created volume successfully. Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created reservations ['1afa1e0d-88b3-4a42-b02a-2ed9fe95ee28', '562443dc-04cf-4272-9480-fb1450b3d63b', 'ce86bc07-c157-4ab3-97b2-ceea6c413cc9', '7d051468-b54e-4e2e-8bd5-2b3355b3a548'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:28 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:28 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:28 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Deleted volume successfully. Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b9b917e5-e428-48c0-bdb5-2a6e68dbed00 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-4c73c942-cf00-4fca-b315-39a4e7ff006d-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-d267e4b0-3571-4004-b832-148066ac9b33-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Lock "cinder-d267e4b0-3571-4004-b832-148066ac9b33-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-quobyte-d267e4b0-3571-4004-b832-148066ac9b33" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-d267e4b0-3571-4004-b832-148066ac9b33" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49bf50e-987a-4d6b-af67-2edc45aafd91]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:28 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 Nov 05 15:15:28 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-b1eddb67-9426-4ffd-969b-88836f776739-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-b1eddb67-9426-4ffd-969b-88836f776739-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-quobyte-b1eddb67-9426-4ffd-969b-88836f776739" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-b1eddb67-9426-4ffd-969b-88836f776739" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6a7f88-ea01-4eac-9270-ac53d6ef062b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:29 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:29 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 Nov 05 15:15:29 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:29 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33 Nov 05 15:15:29 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:29 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d267e4b0-3571-4004-b832-148066ac9b33" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-d267e4b0-3571-4004-b832-148066ac9b33" released by "delete_volume" :: held 0.934s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:29 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739" returned: 0 in 0.525s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:29 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739 Nov 05 15:15:29 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Created reservations ['6e735bb0-8eec-4e45-94d0-a3e86b3064ee', '17f75a0b-a8f4-45b3-b4ce-84021772d26d', 'aaf003f4-4f77-4785-83bb-6b391cef4abf', '7dd8ef2b-36b9-4f0f-b084-7316dea00d77'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:29 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:29 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:29 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b1eddb67-9426-4ffd-969b-88836f776739" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-b1eddb67-9426-4ffd-969b-88836f776739" released by "delete_volume" :: held 0.926s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created reservations ['7c268ded-d2dc-4447-9374-3cdb978c4168', '20ded0ae-f132-4948-b80d-7c2ff818b7e8', '1bf44599-3017-4dfe-8e0c-c8a2918604ac', '6312f5d8-4ffe-4f5f-a074-a1394c06ef23'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:30 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Deleted volume successfully. Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e93fa75-f5d6-4a10-91d1-364640461bbe tempest-ProjectReaderTests-1897515257 None] Lock "cinder-d267e4b0-3571-4004-b832-148066ac9b33-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:30 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:30 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-94a52665-3435-4ec1-8c99-25f433717ded-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-94a52665-3435-4ec1-8c99-25f433717ded-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-quobyte-94a52665-3435-4ec1-8c99-25f433717ded" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-94a52665-3435-4ec1-8c99-25f433717ded" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afced64-1e7d-4b41-bc4f-11d8e2b1c985]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:30 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.510s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Deleted volume successfully. Nov 05 15:15:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-05421a00-adee-4916-828b-2c3088b0ce29 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-b1eddb67-9426-4ffd-969b-88836f776739-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:30 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded Nov 05 15:15:30 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:31 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded" returned: 0 in 0.878s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:31 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded Nov 05 15:15:31 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:31 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-94a52665-3435-4ec1-8c99-25f433717ded" returned: 0 in 0.680s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-94a52665-3435-4ec1-8c99-25f433717ded" released by "delete_volume" :: held 1.687s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created reservations ['d6a95a34-1a4e-4219-8b15-c65e3a2fc259', 'b34bcc93-1131-474b-962e-69d65e3f1ab7', '5f2e2dca-7bdd-4e13-94fd-30a21561b08d', '2f800d9b-49cf-4d01-95d4-999d937817d1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (9133740d-eafb-4e4f-94f5-1ec701efcb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b906eed9-0355-4f37-a494-0b2656d64c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b906eed9-0355-4f37-a494-0b2656d64c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903078912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa72aae0-a72b-4328-b43e-3d211cb90c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:32Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5aa557-fbc5-4194-823c-61a1838691ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5aa557-fbc5-4194-823c-61a1838691ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884e4d9f-d538-4dc6-b873-bf087fa4e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884e4d9f-d538-4dc6-b873-bf087fa4e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa72aae0-a72b-4328-b43e-3d211cb90c02', 'volume_name': 'volume-fa72aae0-a72b-4328-b43e-3d211cb90c02', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0cb675-f620-43d1-8b6d-d33568c56590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0cb675-f620-43d1-8b6d-d33568c56590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7839cdc5-e3c9-4501-a922-4cbcbc585fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Volume fa72aae0-a72b-4328-b43e-3d211cb90c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa72aae0-a72b-4328-b43e-3d211cb90c02', 'volume_size': 1} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903078912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa72aae0-a72b-4328-b43e-3d211cb90c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:32Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Creating volume fa72aae0-a72b-4328-b43e-3d211cb90c02 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:32 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 1073741824 Nov 05 15:15:32 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-7bb6265f-a331-4ee8-a4b1-824c2ce345e2-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:32 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:32 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-7bb6265f-a331-4ee8-a4b1-824c2ce345e2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "cinder-quobyte-7bb6265f-a331-4ee8-a4b1-824c2ce345e2" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Flow 'volume_create_manager' (1a05944d-4dd3-45db-8f18-5981df3d1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1759d7a9-d18e-49ce-8895-92a88974d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-7bb6265f-a331-4ee8-a4b1-824c2ce345e2" acquired by "delete_volume" :: waited 0.185s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1759d7a9-d18e-49ce-8895-92a88974d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1069608131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb10c5f-cb30-426f-b393-6564af99ca7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d879b74a4eae434e9b70085a8b43359c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:33Z,use_quota=True,user_id='e11202806b3c47e1bcca395bc6b7d766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a211a0cb-1c1d-445d-a29e-28689431a6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a211a0cb-1c1d-445d-a29e-28689431a6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e10ea23-669d-4d31-8277-d067056d849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e10ea23-669d-4d31-8277-d067056d849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb10c5f-cb30-426f-b393-6564af99ca7c', 'volume_name': 'volume-7cb10c5f-cb30-426f-b393-6564af99ca7c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b39a4a-268d-4662-b0fe-54d57e054fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b39a4a-268d-4662-b0fe-54d57e054fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e4604c-88f1-406f-96ea-027ecf2c7526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Volume 7cb10c5f-cb30-426f-b393-6564af99ca7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb10c5f-cb30-426f-b393-6564af99ca7c', 'volume_size': 1} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d38603f-2af0-4fc6-b829-18cbc5a85a1a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:33 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.669s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Deleted volume successfully. Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f22eb09-640b-45f0-b8c0-4f7b52ed9d40 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-94a52665-3435-4ec1-8c99-25f433717ded-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:33 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 Nov 05 15:15:33 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:33 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 1073741824" returned: 0 in 1.011s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:33 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 Nov 05 15:15:33 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:33 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:34 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1069608131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb10c5f-cb30-426f-b393-6564af99ca7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d879b74a4eae434e9b70085a8b43359c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:33Z,use_quota=True,user_id='e11202806b3c47e1bcca395bc6b7d766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Creating volume 7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2" returned: 0 in 0.652s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:34 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c 1073741824 Nov 05 15:15:34 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7839cdc5-e3c9-4501-a922-4cbcbc585fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa72aae0-a72b-4328-b43e-3d211cb90c02', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d3d2ca-6436-4477-9e08-d1aeb598fba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:34 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2 Nov 05 15:15:34 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Volume volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 (fa72aae0-a72b-4328-b43e-3d211cb90c02): created successfully Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72d3d2ca-6436-4477-9e08-d1aeb598fba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (9133740d-eafb-4e4f-94f5-1ec701efcb51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cfb95f37-ecdf-443b-9320-acb82239f100 tempest-ProjectReaderTests-1897515257 None] Created volume successfully. Nov 05 15:15:34 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7bb6265f-a331-4ee8-a4b1-824c2ce345e2" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-quobyte-7bb6265f-a331-4ee8-a4b1-824c2ce345e2" released by "delete_volume" :: held 1.279s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Created reservations ['60c0d116-5197-4dd8-bd38-ab99deb7327f', 'bccc3324-2746-43ae-980d-5e39ebd97186', 'a8862bc6-2977-470a-9018-de0e83af97b4', 'd220c677-733a-4566-8692-64c8dffd4a7a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:34 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:34 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:34 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c 1073741824" returned: 0 in 0.853s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:34 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c Nov 05 15:15:34 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:35 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.430s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Deleted volume successfully. Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acff9c83-5f39-4b52-b5fd-2098bd5641b6 tempest-CreateVolumesFromSourceVolumeTest-743641662 None] Lock "cinder-7bb6265f-a331-4ee8-a4b1-824c2ce345e2-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:35 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c" returned: 0 in 0.599s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e4604c-88f1-406f-96ea-027ecf2c7526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb10c5f-cb30-426f-b393-6564af99ca7c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7987099-f17a-43c7-9964-5995a51407cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Volume volume-7cb10c5f-cb30-426f-b393-6564af99ca7c (7cb10c5f-cb30-426f-b393-6564af99ca7c): created successfully Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7987099-f17a-43c7-9964-5995a51407cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Flow 'volume_create_manager' (1a05944d-4dd3-45db-8f18-5981df3d1048) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3fd979c9-2d7e-453e-a52a-3ac5575f88ae tempest-TestStampPattern-316874100 None] Created volume successfully. Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-fa72aae0-a72b-4328-b43e-3d211cb90c02-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-fa72aae0-a72b-4328-b43e-3d211cb90c02-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-quobyte-fa72aae0-a72b-4328-b43e-3d211cb90c02" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-fa72aae0-a72b-4328-b43e-3d211cb90c02" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1950e442-2dec-4117-b115-357faa45e850]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:36 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 Nov 05 15:15:36 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:36 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02" returned: 0 in 0.656s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:36 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02 Nov 05 15:15:36 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:37 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fa72aae0-a72b-4328-b43e-3d211cb90c02" returned: 0 in 0.637s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-fa72aae0-a72b-4328-b43e-3d211cb90c02" released by "delete_volume" :: held 1.390s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Created reservations ['ee62162d-776c-4fb6-8ff7-799993dc54cb', 'e661d399-1b41-40e9-a729-bf6b0b984596', '3e6aaaab-93bd-4405-9238-80e22d202407', '62c8bf18-5f96-42ee-826b-7b1f8ffc4d96'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:37 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:37 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:37 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Deleted volume successfully. Nov 05 15:15:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-03aafe20-d2cb-45bb-b4d2-986467daf3d8 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-fa72aae0-a72b-4328-b43e-3d211cb90c02-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:39 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:39 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (867a6296-4636-4544-a634-9e6efe647b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1166bf77-ac89-4809-9ad3-99a4841e7f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1166bf77-ac89-4809-9ad3-99a4841e7f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450645547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b4e604-3c17-44a0-9227-7a591a0d367e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:39Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f61adb-8511-404b-be80-609b90adc990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f61adb-8511-404b-be80-609b90adc990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f5aaac-6e2e-41de-aa08-eb642d9fc6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f5aaac-6e2e-41de-aa08-eb642d9fc6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b4e604-3c17-44a0-9227-7a591a0d367e', 'volume_name': 'volume-34b4e604-3c17-44a0-9227-7a591a0d367e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1058db76-f19f-4254-a481-868777089288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1058db76-f19f-4254-a481-868777089288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cee30e0-9ad7-4632-b0e0-0b32b8db1b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Volume 34b4e604-3c17-44a0-9227-7a591a0d367e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b4e604-3c17-44a0-9227-7a591a0d367e', 'volume_size': 1} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450645547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b4e604-3c17-44a0-9227-7a591a0d367e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:39Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Creating volume 34b4e604-3c17-44a0-9227-7a591a0d367e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:39 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e 1073741824 Nov 05 15:15:39 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:39 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.568s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:15:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:15:40 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e 1073741824" returned: 0 in 0.639s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:40 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e Nov 05 15:15:40 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:40 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cee30e0-9ad7-4632-b0e0-0b32b8db1b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b4e604-3c17-44a0-9227-7a591a0d367e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185c3de6-a47f-4611-bb6a-2e87cf165e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Volume volume-34b4e604-3c17-44a0-9227-7a591a0d367e (34b4e604-3c17-44a0-9227-7a591a0d367e): created successfully Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185c3de6-a47f-4611-bb6a-2e87cf165e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (867a6296-4636-4544-a634-9e6efe647b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-51f499d7-a2cb-4ed5-8f79-bdc8cfe4e4dd tempest-ProjectReaderTests-1897515257 None] Created volume successfully. Nov 05 15:15:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-34b4e604-3c17-44a0-9227-7a591a0d367e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-34b4e604-3c17-44a0-9227-7a591a0d367e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-quobyte-34b4e604-3c17-44a0-9227-7a591a0d367e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-34b4e604-3c17-44a0-9227-7a591a0d367e" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2926590d-9f45-482b-9e60-4f868ba52ae5]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:41 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e Nov 05 15:15:41 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:42 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e" returned: 0 in 0.976s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:42 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e Nov 05 15:15:42 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:42 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-34b4e604-3c17-44a0-9227-7a591a0d367e" returned: 0 in 0.550s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-34b4e604-3c17-44a0-9227-7a591a0d367e" released by "delete_volume" :: held 1.609s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Created reservations ['8f1dc260-5282-47b8-817e-bdf63687c6e6', '8426ed05-054f-4001-a36a-8a55093585a0', '7de44023-d792-412b-a430-4a4574a873d5', 'f036decd-140c-4e4f-8a2f-03531f020607'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:43 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:43 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:44 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.898s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Deleted volume successfully. Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f381047c-8d8a-475c-b26d-26c949ca78a2 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-34b4e604-3c17-44a0-9227-7a591a0d367e-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (dbcd638a-8d38-45ec-986f-52529e68ec48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37d4291-6918-48d8-aa5f-922449a59703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37d4291-6918-48d8-aa5f-922449a59703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846374857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbc2df0-c6bf-49eb-9b05-01c743c86b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:44Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9105c57e-9461-4e05-acf2-198898f51165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9105c57e-9461-4e05-acf2-198898f51165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5730ac6-a25b-4081-9e40-d052e33302f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5730ac6-a25b-4081-9e40-d052e33302f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbc2df0-c6bf-49eb-9b05-01c743c86b50', 'volume_name': 'volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b74aca-da5c-4544-a4e4-0a85f4d332fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b74aca-da5c-4544-a4e4-0a85f4d332fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d4b075-a7eb-4dc5-acea-0d9f94a8550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Volume 5fbc2df0-c6bf-49eb-9b05-01c743c86b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50', 'volume_size': 1} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846374857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbc2df0-c6bf-49eb-9b05-01c743c86b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d253f36a884da0b99b2cd2c89b3f1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:44Z,use_quota=True,user_id='1dbafc2eb4574163b2b5ec64a95e5a8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Creating volume 5fbc2df0-c6bf-49eb-9b05-01c743c86b50 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:44 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:44 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 1073741824 Nov 05 15:15:44 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:45 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 1073741824" returned: 0 in 0.646s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:45 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 Nov 05 15:15:45 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:45 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d4b075-a7eb-4dc5-acea-0d9f94a8550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b41a54e-5278-4eb3-8549-c4b5e5a0139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:45 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Volume volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 (5fbc2df0-c6bf-49eb-9b05-01c743c86b50): created successfully Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b41a54e-5278-4eb3-8549-c4b5e5a0139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:45 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Flow 'volume_create_manager' (dbcd638a-8d38-45ec-986f-52529e68ec48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8f1fa5d6-44d4-4e22-b8d0-dac82b052b4b tempest-ProjectReaderTests-1897515257 None] Created volume successfully. Nov 05 15:15:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-5fbc2df0-c6bf-49eb-9b05-01c743c86b50-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-5fbc2df0-c6bf-49eb-9b05-01c743c86b50-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "cinder-quobyte-5fbc2df0-c6bf-49eb-9b05-01c743c86b50" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:15:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-5fbc2df0-c6bf-49eb-9b05-01c743c86b50" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:15:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1da9209-60db-4dfc-9fc3-e886b7f7e90f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:15:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:46 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 Nov 05 15:15:46 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:47 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50" returned: 0 in 0.514s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:47 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50 Nov 05 15:15:47 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:47 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5fbc2df0-c6bf-49eb-9b05-01c743c86b50" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-quobyte-5fbc2df0-c6bf-49eb-9b05-01c743c86b50" released by "delete_volume" :: held 0.902s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Created reservations ['cf7fe983-eac6-4468-9a04-dcb3e7420beb', '7315ccd6-ddb6-4aac-85c3-c7018063af34', '0c5b7fbc-879a-48b8-a5ca-56433571df98', 'e952f702-eca1-47be-88ed-6a74b0e438fd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:47 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:15:47 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:48 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:48 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:15:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Deleted volume successfully. Nov 05 15:15:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-56b5b359-55c2-4c46-a33d-b313f71fbf88 tempest-ProjectReaderTests-1897515257 None] Lock "cinder-5fbc2df0-c6bf-49eb-9b05-01c743c86b50-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=218,cinder:SELECT=146,cinder:INSERT=61,cinder:DELETE=14 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=197,cinder:SELECT=135,cinder:DELETE=20,cinder:INSERT=46 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Flow 'volume_create_manager' (718adfe3-aab5-4335-88fd-01921ab35c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ea68bc-b1b9-441f-953a-953fd7ddd476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ea68bc-b1b9-441f-953a-953fd7ddd476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-789997461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71320b48-4672-49f9-a63e-f804afd53611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d63c710d1b43cfa74d5e4ab06d9e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:57Z,use_quota=True,user_id='7560240fbb5c45a6a5a4675ac9deb084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa908e73-3651-4765-aa0d-d2804c962dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa908e73-3651-4765-aa0d-d2804c962dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9def6c-4927-4fe2-900c-3c92570f4c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9def6c-4927-4fe2-900c-3c92570f4c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71320b48-4672-49f9-a63e-f804afd53611', 'volume_name': 'volume-71320b48-4672-49f9-a63e-f804afd53611', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16c93f-eda5-42f2-88e5-143cae7b7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f16c93f-eda5-42f2-88e5-143cae7b7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a8bfc6-d420-43b9-8cac-885b36121b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Volume 71320b48-4672-49f9-a63e-f804afd53611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71320b48-4672-49f9-a63e-f804afd53611', 'volume_size': 1} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-789997461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71320b48-4672-49f9-a63e-f804afd53611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d63c710d1b43cfa74d5e4ab06d9e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:15:57Z,use_quota=True,user_id='7560240fbb5c45a6a5a4675ac9deb084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Creating volume 71320b48-4672-49f9-a63e-f804afd53611 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:15:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:57 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 1073741824 Nov 05 15:15:57 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:57 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 1073741824" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:15:58 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 Nov 05 15:15:58 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:15:58 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a8bfc6-d420-43b9-8cac-885b36121b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71320b48-4672-49f9-a63e-f804afd53611', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dc0a9d-48a4-4074-9a42-98c12c7d6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:15:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Volume volume-71320b48-4672-49f9-a63e-f804afd53611 (71320b48-4672-49f9-a63e-f804afd53611): created successfully Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21dc0a9d-48a4-4074-9a42-98c12c7d6691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:15:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Flow 'volume_create_manager' (718adfe3-aab5-4335-88fd-01921ab35c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:15:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-920de253-1bd0-4e78-b5ee-c8414cc31e47 tempest-AttachVolumeNegativeTest-486724795 None] Created volume successfully. Nov 05 15:15:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-3e99c20a-9e21-40c9-9d08-e06040382427 req-6b575fea-eb85-4fbc-843a-ad3b433edadc tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:15:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-3e99c20a-9e21-40c9-9d08-e06040382427 req-6b575fea-eb85-4fbc-843a-ad3b433edadc tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:15:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-3e99c20a-9e21-40c9-9d08-e06040382427 req-6b575fea-eb85-4fbc-843a-ad3b433edadc tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:15:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-3e99c20a-9e21-40c9-9d08-e06040382427 req-6b575fea-eb85-4fbc-843a-ad3b433edadc tempest-AttachVolumeNegativeTest-486724795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-71320b48-4672-49f9-a63e-f804afd53611', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be7bcdbe-218d-4590-8f94-9e95df7188f8', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:15:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-3e99c20a-9e21-40c9-9d08-e06040382427 req-6b575fea-eb85-4fbc-843a-ad3b433edadc tempest-AttachVolumeNegativeTest-486724795 None] attachment_update completed successfully. Nov 05 15:16:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-cacce505-1278-4a33-8d78-fd78b08a3908 req-22f51d40-c89a-4b2e-91b5-48590ebbecbd tempest-AttachVolumeNegativeTest-486724795 None] Terminate volume connection completed successfully. Nov 05 15:16:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-cacce505-1278-4a33-8d78-fd78b08a3908 req-22f51d40-c89a-4b2e-91b5-48590ebbecbd tempest-AttachVolumeNegativeTest-486724795 None] Deleting attachment be7bcdbe-218d-4590-8f94-9e95df7188f8. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:16:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6ad874de-0234-4667-8a03-6bbef7a0222e req-931dd920-59cd-4229-8348-1bb7dff6ebd4 tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6ad874de-0234-4667-8a03-6bbef7a0222e req-931dd920-59cd-4229-8348-1bb7dff6ebd4 tempest-TestStampPattern-316874100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-6ad874de-0234-4667-8a03-6bbef7a0222e req-931dd920-59cd-4229-8348-1bb7dff6ebd4 tempest-TestStampPattern-316874100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:09 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-6ad874de-0234-4667-8a03-6bbef7a0222e req-931dd920-59cd-4229-8348-1bb7dff6ebd4 tempest-TestStampPattern-316874100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-7cb10c5f-cb30-426f-b393-6564af99ca7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '293e4a61-4878-4465-862b-1dbf8c25c9e8', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:16:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-6ad874de-0234-4667-8a03-6bbef7a0222e req-931dd920-59cd-4229-8348-1bb7dff6ebd4 tempest-TestStampPattern-316874100 None] attachment_update completed successfully. Nov 05 15:16:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-3a8b8b26-1def-4111-af69-06f7db20c8f0 req-92092dad-c90d-494b-ad94-15573f5b389f tempest-TestStampPattern-316874100 None] Terminate volume connection completed successfully. Nov 05 15:16:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-3a8b8b26-1def-4111-af69-06f7db20c8f0 req-92092dad-c90d-494b-ad94-15573f5b389f tempest-TestStampPattern-316874100 None] Deleting attachment 293e4a61-4878-4465-862b-1dbf8c25c9e8. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Creating offline snapshot b2df3e91-e273-454e-91f0-0ea180812d20 of volume 7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[90802a06-d256-45f8-bf4f-95348cc8c991]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:17 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c Nov 05 15:16:17 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:17 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:17 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 1G Nov 05 15:16:17 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:17 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 1G" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb10c5f-cb30-426f-b393-6564af99ca7c -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:18 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb10c5f-cb30-426f-b393-6564af99ca7c -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 Nov 05 15:16:18 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:18 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cb10c5f-cb30-426f-b393-6564af99ca7c -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20" returned: 0 in 0.294s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 is being set with open permissions: ugo+rw Nov 05 15:16:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:18 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 Nov 05 15:16:18 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:18 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:18 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info Nov 05 15:16:18 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:18 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:18 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info is being set with open permissions: ugo+rw Nov 05 15:16:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:18 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info Nov 05 15:16:18 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:19 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.info" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b8290f6e-683b-4d43-9c42-d375ffa7df83 tempest-TestStampPattern-316874100 None] Create snapshot completed successfully Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Flow 'volume_create_manager' (4a50346d-d911-46ad-ad19-d00b9b1ea12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a455b21-4377-4f08-b9f4-45eb5c47c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a455b21-4377-4f08-b9f4-45eb5c47c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1054336597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d231b68c-3168-4346-8f69-fc3fa792edee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d879b74a4eae434e9b70085a8b43359c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2df3e91-e273-454e-91f0-0ea180812d20,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:27Z,use_quota=True,user_id='e11202806b3c47e1bcca395bc6b7d766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8cc92f-721f-4f02-8a64-6f6930471c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8cc92f-721f-4f02-8a64-6f6930471c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e819da-5f81-4975-a90c-1ceb6252b744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38e819da-5f81-4975-a90c-1ceb6252b744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd231b68c-3168-4346-8f69-fc3fa792edee', 'volume_name': 'volume-d231b68c-3168-4346-8f69-fc3fa792edee', 'volume_size': 1, 'snapshot_id': 'b2df3e91-e273-454e-91f0-0ea180812d20'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e419db44-4151-47ac-9994-dbe8ceee3cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e419db44-4151-47ac-9994-dbe8ceee3cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62527b2-c223-45cd-a998-6fda77c974e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Volume d231b68c-3168-4346-8f69-fc3fa792edee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d231b68c-3168-4346-8f69-fc3fa792edee', 'volume_size': 1, 'snapshot_id': 'b2df3e91-e273-454e-91f0-0ea180812d20'} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-quobyte-b2df3e91-e273-454e-91f0-0ea180812d20-d231b68c-3168-4346-8f69-fc3fa792edee" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-b2df3e91-e273-454e-91f0-0ea180812d20-d231b68c-3168-4346-8f69-fc3fa792edee" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Creating volume d231b68c-3168-4346-8f69-fc3fa792edee from snapshot b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-quobyte-d231b68c-3168-4346-8f69-fc3fa792edee" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-d231b68c-3168-4346-8f69-fc3fa792edee" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] snapshot: b2df3e91-e273-454e-91f0-0ea180812d20, volume: d231b68c-3168-4346-8f69-fc3fa792edee, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[26651726-c110-48c4-8f75-bbbd53bd9ed3]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:27 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 Nov 05 15:16:27 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:27 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20" returned: 0 in 0.410s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cb10c5f-cb30-426f-b393-6564af99ca7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6ad627-1a85-444d-95b3-f974fadef940]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:27 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c Nov 05 15:16:27 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:27 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c" returned: 0 in 0.412s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:16:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:27 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee Nov 05 15:16:27 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:36 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=23,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Flow 'volume_create_manager' (3d581cf4-e595-4aec-921f-8aa43b5bb192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dfb135-3a41-4300-8d95-fa010b6df4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13dfb135-3a41-4300-8d95-fa010b6df4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1841654892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714f61a9-c6c9-4e93-889d-27e9bbdedf79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d63c710d1b43cfa74d5e4ab06d9e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:37Z,use_quota=True,user_id='7560240fbb5c45a6a5a4675ac9deb084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e743d60-61c7-4b72-b414-145fa6497a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e743d60-61c7-4b72-b414-145fa6497a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264ae09c-3825-4ff4-9feb-f328b6e23561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (264ae09c-3825-4ff4-9feb-f328b6e23561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '714f61a9-c6c9-4e93-889d-27e9bbdedf79', 'volume_name': 'volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acdeba9-6b1a-4e6b-a916-14dc377d1c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acdeba9-6b1a-4e6b-a916-14dc377d1c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312644a2-6ccb-49e8-897c-7a08bdef7707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Volume 714f61a9-c6c9-4e93-889d-27e9bbdedf79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79', 'volume_size': 1} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:37 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee" returned: 0 in 9.912s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c, size 1024.00 MB, duration 9.91 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:16:37 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Converted 1024.00 MB image at 103.30 MB/s Nov 05 15:16:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee is being set with open permissions: ugo+rw Nov 05 15:16:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:37 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee Nov 05 15:16:37 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:38 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-d231b68c-3168-4346-8f69-fc3fa792edee" released by "_copy_volume_from_snapshot" :: held 11.101s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-b2df3e91-e273-454e-91f0-0ea180812d20-d231b68c-3168-4346-8f69-fc3fa792edee" released by "_create_volume_from_snapshot" :: held 11.263s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.280s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1841654892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=714f61a9-c6c9-4e93-889d-27e9bbdedf79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89d63c710d1b43cfa74d5e4ab06d9e38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:37Z,use_quota=True,user_id='7560240fbb5c45a6a5a4675ac9deb084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Creating volume 714f61a9-c6c9-4e93-889d-27e9bbdedf79 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:16:38 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:38 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 1073741824 Nov 05 15:16:38 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f62527b2-c223-45cd-a998-6fda77c974e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d231b68c-3168-4346-8f69-fc3fa792edee', 'volume_size': 1, 'snapshot_id': 'b2df3e91-e273-454e-91f0-0ea180812d20'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f332e1e3-b300-41e2-8660-4973bbb1939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Volume volume-d231b68c-3168-4346-8f69-fc3fa792edee (d231b68c-3168-4346-8f69-fc3fa792edee): created successfully Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f332e1e3-b300-41e2-8660-4973bbb1939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Flow 'volume_create_manager' (4a50346d-d911-46ad-ad19-d00b9b1ea12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:16:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-32f15d00-a2e0-4e05-a333-5843831c04ca tempest-TestStampPattern-316874100 None] Created volume successfully. Nov 05 15:16:38 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 1073741824" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:38 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 Nov 05 15:16:38 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:39 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:16:39 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:39 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79" returned: 0 in 0.316s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312644a2-6ccb-49e8-897c-7a08bdef7707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce44ac7-99de-44ab-a741-383fe5af9448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Volume volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 (714f61a9-c6c9-4e93-889d-27e9bbdedf79): created successfully Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce44ac7-99de-44ab-a741-383fe5af9448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Flow 'volume_create_manager' (3d581cf4-e595-4aec-921f-8aa43b5bb192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:16:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f04d2660-41e2-49eb-a6cb-5fbf999d55f0 tempest-AttachVolumeNegativeTest-486724795 None] Created volume successfully. Nov 05 15:16:39 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.327s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:16:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:16:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7a7e401a-5a23-4987-9fb8-5c7bb0fbd115 req-b94e1205-6e26-46ea-a2b9-88c70d613fe8 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7a7e401a-5a23-4987-9fb8-5c7bb0fbd115 req-b94e1205-6e26-46ea-a2b9-88c70d613fe8 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-7a7e401a-5a23-4987-9fb8-5c7bb0fbd115 req-b94e1205-6e26-46ea-a2b9-88c70d613fe8 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-7a7e401a-5a23-4987-9fb8-5c7bb0fbd115 req-b94e1205-6e26-46ea-a2b9-88c70d613fe8 tempest-AttachVolumeNegativeTest-486724795 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '720e6b85-9005-4458-869c-b7862a6d80bd', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:16:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-7a7e401a-5a23-4987-9fb8-5c7bb0fbd115 req-b94e1205-6e26-46ea-a2b9-88c70d613fe8 tempest-AttachVolumeNegativeTest-486724795 None] attachment_update completed successfully. Nov 05 15:16:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-21886591-93f8-4f12-9c93-9fc84c71379e req-ef0d9844-e2f3-43c6-a444-95a5b704a579 tempest-AttachVolumeNegativeTest-486724795 None] Terminate volume connection completed successfully. Nov 05 15:16:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-21886591-93f8-4f12-9c93-9fc84c71379e req-ef0d9844-e2f3-43c6-a444-95a5b704a579 tempest-AttachVolumeNegativeTest-486724795 None] Deleting attachment 720e6b85-9005-4458-869c-b7862a6d80bd. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:16:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "cinder-714f61a9-c6c9-4e93-889d-27e9bbdedf79-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-714f61a9-c6c9-4e93-889d-27e9bbdedf79-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "cinder-quobyte-714f61a9-c6c9-4e93-889d-27e9bbdedf79" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-quobyte-714f61a9-c6c9-4e93-889d-27e9bbdedf79" acquired by "delete_volume" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfd8456-602c-413a-957d-8307bb52311e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:16:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:47 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 Nov 05 15:16:47 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:48 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:48 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79 Nov 05 15:16:48 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:48 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-714f61a9-c6c9-4e93-889d-27e9bbdedf79" returned: 0 in 0.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-quobyte-714f61a9-c6c9-4e93-889d-27e9bbdedf79" released by "delete_volume" :: held 0.695s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Created reservations ['f05b89a0-0343-484f-bad5-821e8c7130f3', '96173a74-534c-4e18-bc08-4cb3ae021d3c', '473d2b69-fd43-4c21-856e-0d73b1d4d8ba', '0489c4f9-8041-49b0-8765-c31a044dcc52'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:48 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:16:48 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:48 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:16:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Deleted volume successfully. Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dcfdeaa-8aa1-465d-858c-214fa4eadcae tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-714f61a9-c6c9-4e93-889d-27e9bbdedf79-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "cinder-71320b48-4672-49f9-a63e-f804afd53611-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-71320b48-4672-49f9-a63e-f804afd53611-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "cinder-quobyte-71320b48-4672-49f9-a63e-f804afd53611" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-quobyte-71320b48-4672-49f9-a63e-f804afd53611" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[96291895-e298-403d-8aee-e02a53105c82]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:16:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:49 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 Nov 05 15:16:49 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:49 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:49 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611 Nov 05 15:16:49 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:49 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-71320b48-4672-49f9-a63e-f804afd53611" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-quobyte-71320b48-4672-49f9-a63e-f804afd53611" released by "delete_volume" :: held 0.661s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Created reservations ['1f594563-1ce6-4a26-8395-3b0b9745fcb4', '2383d1d0-babc-4746-963d-ae7ed9415d15', '18aad0f7-fc58-4298-8606-56275b4e412d', '1e1dd3a2-aa4b-4875-8970-66d5d8b622bc'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:49 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:16:49 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:49 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:49 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:16:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Deleted volume successfully. Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9c3d27fa-116d-4d93-9a7e-665d2d3cc305 tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-71320b48-4672-49f9-a63e-f804afd53611-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "cinder-1c8042ce-46c1-4134-b180-4506114e638f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-1c8042ce-46c1-4134-b180-4506114e638f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "cinder-quobyte-1c8042ce-46c1-4134-b180-4506114e638f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-quobyte-1c8042ce-46c1-4134-b180-4506114e638f" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3889d9ee-16e5-4dc7-bcff-a18130aa7523]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:50 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f Nov 05 15:16:50 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:50 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:50 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f Nov 05 15:16:50 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:51 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-1c8042ce-46c1-4134-b180-4506114e638f" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-quobyte-1c8042ce-46c1-4134-b180-4506114e638f" released by "delete_volume" :: held 0.638s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Created reservations ['f17c073d-0eff-4daf-a1eb-168214bbb052', 'a3ca852b-ce09-493d-b1a2-eacdcff46dc3', '39cecbcc-0374-4df0-99e1-8533cefa34b3', '28662896-4d5f-4d37-a715-24dda89575b3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:51 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:16:51 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:51 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:16:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Deleted volume successfully. Nov 05 15:16:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb8851f-d631-4154-ba35-4e429bea673e tempest-AttachVolumeNegativeTest-486724795 None] Lock "cinder-1c8042ce-46c1-4134-b180-4506114e638f-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Flow 'volume_create_manager' (6f87a78c-415a-4bf1-852c-ae0eb3875181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba629808-fe77-4ba2-80be-fd5c2daf6e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba629808-fe77-4ba2-80be-fd5c2daf6e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-720618243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c867c5-7170-4fdc-9dbe-66a62132cb50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='074f21e8cd2e4212ac0cf526f16068aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:59Z,use_quota=True,user_id='8503099face3473d8abcf798b428582a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441701f8-3825-4ffc-8cd7-80b7f53af1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441701f8-3825-4ffc-8cd7-80b7f53af1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1ce961-8f9e-4e72-a64c-12996f1826d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1ce961-8f9e-4e72-a64c-12996f1826d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c867c5-7170-4fdc-9dbe-66a62132cb50', 'volume_name': 'volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e9839c-3322-4728-871c-26eeffc9e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e9839c-3322-4728-871c-26eeffc9e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a382d-c72b-4365-97a3-0ac44814d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:58 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Volume f3c867c5-7170-4fdc-9dbe-66a62132cb50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50', 'volume_size': 1} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-720618243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c867c5-7170-4fdc-9dbe-66a62132cb50,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='074f21e8cd2e4212ac0cf526f16068aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:16:59Z,use_quota=True,user_id='8503099face3473d8abcf798b428582a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Creating volume f3c867c5-7170-4fdc-9dbe-66a62132cb50 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:16:58 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:16:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:58 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 1073741824 Nov 05 15:16:58 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:59 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 1073741824" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:16:59 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 Nov 05 15:16:59 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:16:59 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a382d-c72b-4365-97a3-0ac44814d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5569b1-753f-4e9d-81c9-f6471216f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:16:59 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Volume volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 (f3c867c5-7170-4fdc-9dbe-66a62132cb50): created successfully Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5569b1-753f-4e9d-81c9-f6471216f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:16:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Flow 'volume_create_manager' (6f87a78c-415a-4bf1-852c-ae0eb3875181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:16:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a420e4b4-e5a5-4514-b4c3-b6aef7341b1c tempest-VolumesTestJSON-87841292 None] Created volume successfully. Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Flow 'volume_create_manager' (26a3d1a6-230e-44a2-bba5-c67fab512aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9713ee6-7cfa-41af-8ae2-1afa6f8799ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9713ee6-7cfa-41af-8ae2-1afa6f8799ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-362589752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d52d8af-7ddc-4c5f-bd77-debbabab8ea0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='074f21e8cd2e4212ac0cf526f16068aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:00Z,use_quota=True,user_id='8503099face3473d8abcf798b428582a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0798dc-f839-4d72-a168-0f41ebd8af41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0798dc-f839-4d72-a168-0f41ebd8af41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d39593-fed5-4351-87b2-33c389a26a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d39593-fed5-4351-87b2-33c389a26a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d52d8af-7ddc-4c5f-bd77-debbabab8ea0', 'volume_name': 'volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b95efd-b928-4ab3-b4c6-2b6edb227345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b95efd-b928-4ab3-b4c6-2b6edb227345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af45fe18-e455-4d42-9ecb-55168c4987ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Volume 5d52d8af-7ddc-4c5f-bd77-debbabab8ea0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0', 'volume_size': 1} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-362589752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d52d8af-7ddc-4c5f-bd77-debbabab8ea0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='074f21e8cd2e4212ac0cf526f16068aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:00Z,use_quota=True,user_id='8503099face3473d8abcf798b428582a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Creating volume 5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:00 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:00 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 1073741824 Nov 05 15:17:00 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:00 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 1073741824" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:00 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 Nov 05 15:17:00 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:00 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af45fe18-e455-4d42-9ecb-55168c4987ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34e6850-b5f9-4306-91c9-1e4509110951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Volume volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 (5d52d8af-7ddc-4c5f-bd77-debbabab8ea0): created successfully Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a34e6850-b5f9-4306-91c9-1e4509110951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Flow 'volume_create_manager' (26a3d1a6-230e-44a2-bba5-c67fab512aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c8a4c636-0f46-4279-876c-98a39b111c66 tempest-VolumesTestJSON-87841292 None] Created volume successfully. Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Flow 'volume_create_manager' (3e9fee28-f7cd-4a64-9369-414fde132201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401154f3-660c-4bd8-8ac0-e28361791ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401154f3-660c-4bd8-8ac0-e28361791ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1427152371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4fb51c-518d-4212-965b-b215e4087328,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='074f21e8cd2e4212ac0cf526f16068aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:02Z,use_quota=True,user_id='8503099face3473d8abcf798b428582a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecd4472-7035-401d-ac13-e90308572d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aecd4472-7035-401d-ac13-e90308572d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f388c18-f3c1-4aae-a76d-b2b5b381e4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f388c18-f3c1-4aae-a76d-b2b5b381e4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e4fb51c-518d-4212-965b-b215e4087328', 'volume_name': 'volume-5e4fb51c-518d-4212-965b-b215e4087328', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4afa0d-688b-478e-a930-d009637636dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4afa0d-688b-478e-a930-d009637636dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1609478-d707-4b78-bce3-b8e8b1efe783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:01 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Volume 5e4fb51c-518d-4212-965b-b215e4087328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e4fb51c-518d-4212-965b-b215e4087328', 'volume_size': 1} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1427152371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4fb51c-518d-4212-965b-b215e4087328,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='074f21e8cd2e4212ac0cf526f16068aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:02Z,use_quota=True,user_id='8503099face3473d8abcf798b428582a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Creating volume 5e4fb51c-518d-4212-965b-b215e4087328 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:01 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:01 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 1073741824 Nov 05 15:17:01 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:02 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 1073741824" returned: 0 in 0.474s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:02 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 Nov 05 15:17:02 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:02 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1609478-d707-4b78-bce3-b8e8b1efe783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4fb51c-518d-4212-965b-b215e4087328', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4d24b3-21b8-4469-85c1-63b4213ffd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:02 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Volume volume-5e4fb51c-518d-4212-965b-b215e4087328 (5e4fb51c-518d-4212-965b-b215e4087328): created successfully Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d4d24b3-21b8-4469-85c1-63b4213ffd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:02 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Flow 'volume_create_manager' (3e9fee28-f7cd-4a64-9369-414fde132201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-792415d5-1947-46e7-952f-aa38c2067ed2 tempest-VolumesTestJSON-87841292 None] Created volume successfully. Nov 05 15:17:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Acquiring lock "cinder-5e4fb51c-518d-4212-965b-b215e4087328-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-5e4fb51c-518d-4212-965b-b215e4087328-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Acquiring lock "cinder-quobyte-5e4fb51c-518d-4212-965b-b215e4087328" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-quobyte-5e4fb51c-518d-4212-965b-b215e4087328" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bb45bc-97e5-48fb-8704-159890809925]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:03 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 Nov 05 15:17:03 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:04 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:04 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328 Nov 05 15:17:04 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:04 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e4fb51c-518d-4212-965b-b215e4087328" returned: 0 in 0.247s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-quobyte-5e4fb51c-518d-4212-965b-b215e4087328" released by "delete_volume" :: held 0.665s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Created reservations ['4cdc407f-fc1d-4fd7-8443-47f585233a17', 'e99d67d3-4bcd-4a8e-bd12-263c3e8130b4', 'f6ea9f36-21df-45df-bff3-3fe9b3b9d5db', 'e023ae25-bc4f-4cf9-bf90-bfb729b272a1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:04 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:04 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:04 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Deleted volume successfully. Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Acquiring lock "cinder-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Lock "cinder-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1a1008a4-4779-4c87-a9b3-3b902bb15fe3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-5e4fb51c-518d-4212-965b-b215e4087328-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Acquiring lock "cinder-quobyte-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Lock "cinder-quobyte-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc617bb-0ce6-4500-9372-8c76500f5c46]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:04 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 Nov 05 15:17:04 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:05 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:05 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0 Nov 05 15:17:05 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:05 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Lock "cinder-quobyte-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0" released by "delete_volume" :: held 0.662s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Created reservations ['77b1823f-dacc-4bd7-a494-8f5e69aa94e1', 'b4dc4c3d-f8f7-464c-a25d-400d7bc73fe4', '65f1351f-21aa-45bd-8736-b62a06f76f65', '179b4b11-ce16-4f23-81f6-eac1a33c41b7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:05 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:05 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:05 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Deleted volume successfully. Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d414182e-dcf1-4e44-b19b-445557db3587 tempest-VolumesTestJSON-87841292 None] Lock "cinder-5d52d8af-7ddc-4c5f-bd77-debbabab8ea0-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Acquiring lock "cinder-f3c867c5-7170-4fdc-9dbe-66a62132cb50-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-f3c867c5-7170-4fdc-9dbe-66a62132cb50-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Acquiring lock "cinder-quobyte-f3c867c5-7170-4fdc-9dbe-66a62132cb50" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-quobyte-f3c867c5-7170-4fdc-9dbe-66a62132cb50" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[609636fa-f777-4ddb-9921-39e4e6059e78]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:06 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 Nov 05 15:17:06 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:06 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:06 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50 Nov 05 15:17:06 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:06 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f3c867c5-7170-4fdc-9dbe-66a62132cb50" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-quobyte-f3c867c5-7170-4fdc-9dbe-66a62132cb50" released by "delete_volume" :: held 0.652s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Created reservations ['517c9c13-2418-4570-be01-246ba56e708b', '295cf547-02e6-47fe-b7c6-8fc3f550536b', '5ebfd26f-c595-47d1-acfc-6960088aba96', 'c9af6f14-2d03-4deb-9322-0eab6788db9e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:06 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:06 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:06 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:06 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Deleted volume successfully. Nov 05 15:17:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-45a01e86-1de9-4ff1-b573-8e5db6c175b3 tempest-VolumesTestJSON-87841292 None] Lock "cinder-f3c867c5-7170-4fdc-9dbe-66a62132cb50-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4c04d335-4d12-4a82-a46f-6c0207c53ede tempest-GroupSnapshotsTest-1914991278 None] Group tempest-GroupSnapshotsTest-Group-285016420: creating Nov 05 15:17:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4c04d335-4d12-4a82-a46f-6c0207c53ede tempest-GroupSnapshotsTest-1914991278 None] Group tempest-GroupSnapshotsTest-Group-285016420: created successfully Nov 05 15:17:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4c04d335-4d12-4a82-a46f-6c0207c53ede tempest-GroupSnapshotsTest-1914991278 None] Create group completed successfully. Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (9f5afbc1-bccc-416f-98d3-10530d2cb758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7da48f5-2acb-4f33-9c3e-a47192bfaf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7da48f5-2acb-4f33-9c3e-a47192bfaf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-661396720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb9ed7ac-f2df-4393-a354-6f71c12864c0,host='devstack@QuobyteHD#QuobyteHD',id=ca7b8bc5-5243-41b7-b474-018869d5a414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:12Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34b16776-7f9f-478f-ae1a-3551abec370c),volume_type_id=34b16776-7f9f-478f-ae1a-3551abec370c)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ba1b3d-056a-479f-a4ee-32a04ce650ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ba1b3d-056a-479f-a4ee-32a04ce650ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53db8e1-22b1-472b-863c-6f898052467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53db8e1-22b1-472b-863c-6f898052467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca7b8bc5-5243-41b7-b474-018869d5a414', 'volume_name': 'volume-ca7b8bc5-5243-41b7-b474-018869d5a414', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4fabe7-1af6-4f55-b969-ca3ae68dfd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4fabe7-1af6-4f55-b969-ca3ae68dfd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d69bc8-d4c3-44af-975b-a0aeaae11357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Volume ca7b8bc5-5243-41b7-b474-018869d5a414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca7b8bc5-5243-41b7-b474-018869d5a414', 'volume_size': 1} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb9ed7ac-f2df-4393-a354-6f71c12864c0,created_at=2026-11-05T14:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-661396720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb9ed7ac-f2df-4393-a354-6f71c12864c0,host='devstack@QuobyteHD#QuobyteHD',id=ca7b8bc5-5243-41b7-b474-018869d5a414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:12Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34b16776-7f9f-478f-ae1a-3551abec370c),volume_type_id=34b16776-7f9f-478f-ae1a-3551abec370c)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Creating volume ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:12 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:12 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 1073741824 Nov 05 15:17:12 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:13 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 1073741824" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:13 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 Nov 05 15:17:13 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:13 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d69bc8-d4c3-44af-975b-a0aeaae11357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca7b8bc5-5243-41b7-b474-018869d5a414', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c00a781-4e9d-4f07-8627-1b58442eb04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Volume volume-ca7b8bc5-5243-41b7-b474-018869d5a414 (ca7b8bc5-5243-41b7-b474-018869d5a414): created successfully Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c00a781-4e9d-4f07-8627-1b58442eb04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (9f5afbc1-bccc-416f-98d3-10530d2cb758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-28ad9aa8-34c7-48d2-b42e-436901957827 tempest-GroupSnapshotsTest-1914991278 None] Created volume successfully. Nov 05 15:17:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] GroupSnapshot 3542e326-58c1-4f1e-aeac-34ea622ea312: creating. Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Group snapshot 3542e326-58c1-4f1e-aeac-34ea622ea312: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Creating offline snapshot eadb5832-645a-4392-a9cf-3890154d95a5 of volume ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26c5976-6dd8-42c8-8783-71af9cbfda25]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:14 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 Nov 05 15:17:14 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:14 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:14 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 1G Nov 05 15:17:14 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:14 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 1G" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca7b8bc5-5243-41b7-b474-018869d5a414 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:14 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca7b8bc5-5243-41b7-b474-018869d5a414 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 Nov 05 15:17:14 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:15 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca7b8bc5-5243-41b7-b474-018869d5a414 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:15 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 Nov 05 15:17:15 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:15 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:15 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info Nov 05 15:17:15 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:15 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:15 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info Nov 05 15:17:15 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:15 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.info" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-919eaa5d-e89e-4561-a644-af9c07e80615 tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3542e326-58c1-4f1e-aeac-34ea622ea312: created successfully Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-eadb5832-645a-4392-a9cf-3890154d95a5-775c3248-b8f5-42cb-9e2a-3a23963ccb43" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-eadb5832-645a-4392-a9cf-3890154d95a5-775c3248-b8f5-42cb-9e2a-3a23963ccb43" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Creating volume 775c3248-b8f5-42cb-9e2a-3a23963ccb43 from snapshot eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-775c3248-b8f5-42cb-9e2a-3a23963ccb43" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-775c3248-b8f5-42cb-9e2a-3a23963ccb43" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] snapshot: eadb5832-645a-4392-a9cf-3890154d95a5, volume: 775c3248-b8f5-42cb-9e2a-3a23963ccb43, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f99815-2430-4d0c-9a38-069f0362992d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:16 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 Nov 05 15:17:16 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:17 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca7b8bc5-5243-41b7-b474-018869d5a414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae320f-4b29-401f-8cf8-871711b4c391]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:17 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 Nov 05 15:17:17 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:17 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:17:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:17 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 Nov 05 15:17:17 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-28ef7dbf-dc4a-473e-8a1f-1c92455d34ec req-494afdc5-7a8d-4932-8f25-5e98c78202a2 tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:23 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43" returned: 0 in 6.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:23 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:17:23 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Converted 1024.00 MB image at 163.61 MB/s Nov 05 15:17:23 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:23 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 Nov 05 15:17:23 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:24 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-775c3248-b8f5-42cb-9e2a-3a23963ccb43" released by "_copy_volume_from_snapshot" :: held 7.329s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-eadb5832-645a-4392-a9cf-3890154d95a5-775c3248-b8f5-42cb-9e2a-3a23963ccb43" released by "_create_volume_from_snapshot" :: held 7.399s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.417s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-28ef7dbf-dc4a-473e-8a1f-1c92455d34ec req-494afdc5-7a8d-4932-8f25-5e98c78202a2 tempest-TestStampPattern-316874100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.980s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [req-28ef7dbf-dc4a-473e-8a1f-1c92455d34ec req-494afdc5-7a8d-4932-8f25-5e98c78202a2 tempest-TestStampPattern-316874100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-28ef7dbf-dc4a-473e-8a1f-1c92455d34ec req-494afdc5-7a8d-4932-8f25-5e98c78202a2 tempest-TestStampPattern-316874100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d', 'name': 'volume-d231b68c-3168-4346-8f69-fc3fa792edee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9058914-82d1-4e89-ab40-131a56fd096a', 'enforce_multipath': True} {{(pid=87126) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 15:17:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-434a9adf-0fbd-4909-b770-13fadbc78cbc tempest-GroupSnapshotsTest-1914991278 None] Create group from source-snapshot-3542e326-58c1-4f1e-aeac-34ea622ea312 completed successfully. Nov 05 15:17:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-28ef7dbf-dc4a-473e-8a1f-1c92455d34ec req-494afdc5-7a8d-4932-8f25-5e98c78202a2 tempest-TestStampPattern-316874100 None] attachment_update completed successfully. Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-775c3248-b8f5-42cb-9e2a-3a23963ccb43" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-775c3248-b8f5-42cb-9e2a-3a23963ccb43" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1f1a74-03c6-4317-910b-1c0bb8061556]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:25 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 Nov 05 15:17:25 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:25 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43" returned: 0 in 0.374s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:25 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43 Nov 05 15:17:25 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:25 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-775c3248-b8f5-42cb-9e2a-3a23963ccb43" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-775c3248-b8f5-42cb-9e2a-3a23963ccb43" released by "delete_volume" :: held 0.695s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['0254d8c4-aabf-461e-98b5-70f0f73006c1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:25 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-32728703 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-32728703, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:17:25 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-32728703 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-32728703, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['2930e9e2-d82a-480c-9a0c-a89e4751eaa0', '3f5b20a9-425b-4b49-9456-958f49828aa6', '97c4bab7-69bc-4498-b8ee-3d3a8668173e', '34c308d4-0419-497b-8f05-0f210a4f0518'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:25 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:25 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:26 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2d919ca6-e610-4f47-9a93-b5b3b51a05b4 tempest-GroupSnapshotsTest-1914991278 None] Delete group completed successfully. Nov 05 15:17:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3542e326-58c1-4f1e-aeac-34ea622ea312: deleting Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3542e326-58c1-4f1e-aeac-34ea622ea312: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-ca7b8bc5-5243-41b7-b474-018869d5a414" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-ca7b8bc5-5243-41b7-b474-018869d5a414" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-eadb5832-645a-4392-a9cf-3890154d95a5" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-eadb5832-645a-4392-a9cf-3890154d95a5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Deleting offline snapshot eadb5832-645a-4392-a9cf-3890154d95a5 of volume ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] snapshot_file for this snap is: volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[195efec3-b9e3-4988-a191-add045480d7e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:26 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 Nov 05 15:17:26 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:26 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca7b8bc5-5243-41b7-b474-018869d5a414(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[056d28a3-ab3d-4c1b-a981-93d0d6c6f55f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:26 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 Nov 05 15:17:26 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [req-331240f3-e8c9-426d-bc80-65fbafcf3234 req-e353f724-f60f-4ce0-9e2f-62613fb2c48f tempest-TestStampPattern-316874100 None] Terminate volume connection completed successfully. Nov 05 15:17:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [req-331240f3-e8c9-426d-bc80-65fbafcf3234 req-e353f724-f60f-4ce0-9e2f-62613fb2c48f tempest-TestStampPattern-316874100 None] Deleting attachment d9058914-82d1-4e89-ab40-131a56fd096a. {{(pid=87126) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 05 15:17:27 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414" returned: 0 in 0.606s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:27 devstack sudo[105369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 Nov 05 15:17:27 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:27 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:27 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5 Nov 05 15:17:27 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:28 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414.eadb5832-645a-4392-a9cf-3890154d95a5" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-eadb5832-645a-4392-a9cf-3890154d95a5" released by "_delete_snapshot" :: held 1.741s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-ca7b8bc5-5243-41b7-b474-018869d5a414" released by "delete_snapshot" :: held 1.771s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:28 devstack cinder-volume[87126]: WARNING cinder.quota [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-32728703 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-32728703, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['7370aa53-2dfe-40e1-8391-9c0d783eecc4', 'a296c40e-efda-49d4-915c-98b13ae23920', '32962a99-e763-4415-a617-b8c06c7efbb0', '08a8b03e-fdf4-4920-9e8e-fac1436b80a4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-53d21176-230c-4b72-9f0e-b92eee18539b tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3542e326-58c1-4f1e-aeac-34ea622ea312: deleted successfully Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-ca7b8bc5-5243-41b7-b474-018869d5a414" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-ca7b8bc5-5243-41b7-b474-018869d5a414" acquired by "delete_volume" :: waited 0.036s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[313b4f13-2fdc-441c-b68e-984fc510e639]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:29 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 Nov 05 15:17:29 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:29 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414" returned: 0 in 0.620s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:29 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414 Nov 05 15:17:29 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:29 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ca7b8bc5-5243-41b7-b474-018869d5a414" returned: 0 in 0.273s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-ca7b8bc5-5243-41b7-b474-018869d5a414" released by "delete_volume" :: held 0.985s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['e5fe92f6-4d37-4ef8-8b12-fed62bb6ea69'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:30 devstack cinder-volume[87126]: WARNING cinder.db.api [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-32728703'] Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['6081b47a-7357-4b54-af4d-33ac355a6ece', 'e3ff9925-4728-4b30-9f16-151ceb74ea06', '15ed57cf-733a-4046-8a90-91f1600519b2', '2e621f8b-e328-442e-953b-637e2d3bfaae'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:30 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:30 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:30 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.294s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-87358467-600f-4cfa-952c-f40501d1ea20 tempest-GroupSnapshotsTest-1914991278 None] Delete group completed successfully. Nov 05 15:17:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-d231b68c-3168-4346-8f69-fc3fa792edee-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Lock "cinder-d231b68c-3168-4346-8f69-fc3fa792edee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-quobyte-d231b68c-3168-4346-8f69-fc3fa792edee" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-d231b68c-3168-4346-8f69-fc3fa792edee" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:31 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[524be842-6676-4cd7-a21f-3d9de09279c4]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ffd2b047-1483-4206-a416-e857489f700e tempest-GroupSnapshotsTest-1914991278 None] Group tempest-GroupSnapshotsTest-Group-1246048068: creating Nov 05 15:17:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ffd2b047-1483-4206-a416-e857489f700e tempest-GroupSnapshotsTest-1914991278 None] Group tempest-GroupSnapshotsTest-Group-1246048068: created successfully Nov 05 15:17:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ffd2b047-1483-4206-a416-e857489f700e tempest-GroupSnapshotsTest-1914991278 None] Create group completed successfully. Nov 05 15:17:31 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee Nov 05 15:17:31 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:32 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:32 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee Nov 05 15:17:32 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:32 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d231b68c-3168-4346-8f69-fc3fa792edee" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-d231b68c-3168-4346-8f69-fc3fa792edee" released by "delete_volume" :: held 0.681s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Created reservations ['31f7ff7d-a2a2-4963-b36e-db83002dfbcb', '4eebbe6e-69c0-4a3b-970d-09c1e39e0bc5', '34b8c70e-2564-499a-a451-2b0554b46a6e', '9b760924-8cbd-4845-ae24-eeb19b29a8e7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:32 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:32 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:32 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Deleted volume successfully. Nov 05 15:17:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-21a453b0-6d99-4e3b-b8dc-9cbba042fbb3 tempest-TestStampPattern-316874100 None] Lock "cinder-d231b68c-3168-4346-8f69-fc3fa792edee-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-b2df3e91-e273-454e-91f0-0ea180812d20-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Lock "cinder-b2df3e91-e273-454e-91f0-0ea180812d20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-quobyte-7cb10c5f-cb30-426f-b393-6564af99ca7c" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-7cb10c5f-cb30-426f-b393-6564af99ca7c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-quobyte-b2df3e91-e273-454e-91f0-0ea180812d20" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-b2df3e91-e273-454e-91f0-0ea180812d20" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Deleting offline snapshot b2df3e91-e273-454e-91f0-0ea180812d20 of volume 7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] snapshot_file for this snap is: volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d52aa-1eaa-4e28-ac16-45102d8d6604]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:33 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 Nov 05 15:17:33 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (7d031b05-d700-4695-a1f4-d810ad4a27f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ebdb14-d9ba-4803-b224-3d5d07a980e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ebdb14-d9ba-4803-b224-3d5d07a980e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907084404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b606a927-b37a-4334-8645-f7f30ec7ecfb,host='devstack@QuobyteHD#QuobyteHD',id=bc972e15-cdee-4147-b47c-489d49239193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:33Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7427a53f-6132-49e5-9198-6fdf3418bad4),volume_type_id=7427a53f-6132-49e5-9198-6fdf3418bad4)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fe150e-8bb6-4388-b812-7c594afbc275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fe150e-8bb6-4388-b812-7c594afbc275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6daaddf8-61d4-448d-aa47-ad9cbe0eff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6daaddf8-61d4-448d-aa47-ad9cbe0eff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc972e15-cdee-4147-b47c-489d49239193', 'volume_name': 'volume-bc972e15-cdee-4147-b47c-489d49239193', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa32abe-1ba6-43b5-b281-33c5eba20b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa32abe-1ba6-43b5-b281-33c5eba20b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c639cee5-d43e-4fec-a97c-c68a61894f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Volume bc972e15-cdee-4147-b47c-489d49239193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc972e15-cdee-4147-b47c-489d49239193', 'volume_size': 1} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b606a927-b37a-4334-8645-f7f30ec7ecfb,created_at=2026-11-05T14:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1907084404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b606a927-b37a-4334-8645-f7f30ec7ecfb,host='devstack@QuobyteHD#QuobyteHD',id=bc972e15-cdee-4147-b47c-489d49239193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:33Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7427a53f-6132-49e5-9198-6fdf3418bad4),volume_type_id=7427a53f-6132-49e5-9198-6fdf3418bad4)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Creating volume bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:33 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:33 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 1073741824 Nov 05 15:17:33 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:33 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cb10c5f-cb30-426f-b393-6564af99ca7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[881ac8d0-48d7-47d2-b8fa-08e7edbb39c6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:33 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c Nov 05 15:17:33 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:33 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 1073741824" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:33 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 Nov 05 15:17:33 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:34 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c" returned: 0 in 0.546s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:34 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 Nov 05 15:17:34 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:34 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c639cee5-d43e-4fec-a97c-c68a61894f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc972e15-cdee-4147-b47c-489d49239193', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c37709c-3fff-4b88-bf49-0baf75ee4729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Volume volume-bc972e15-cdee-4147-b47c-489d49239193 (bc972e15-cdee-4147-b47c-489d49239193): created successfully Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c37709c-3fff-4b88-bf49-0baf75ee4729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (7d031b05-d700-4695-a1f4-d810ad4a27f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a411203d-49bf-43b6-a573-fa39855a6d86 tempest-GroupSnapshotsTest-1914991278 None] Created volume successfully. Nov 05 15:17:34 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:34 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20 Nov 05 15:17:34 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:34 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c.b2df3e91-e273-454e-91f0-0ea180812d20" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-b2df3e91-e273-454e-91f0-0ea180812d20" released by "_delete_snapshot" :: held 1.670s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-7cb10c5f-cb30-426f-b393-6564af99ca7c" released by "delete_snapshot" :: held 1.692s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Created reservations ['e1b3c9ee-b159-4e4a-9d26-afada5dee2ab', 'f9018b29-5c32-4b3e-8d09-b2a12639e023', '37a38de9-fb56-45a7-a4ed-34e1ce33925b', '2fc213f1-a34a-4631-be95-bd8cd19f987d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Delete snapshot completed successfully. Nov 05 15:17:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3dd655e7-3df6-4fc5-9839-4e5ef6a61dd2 tempest-TestStampPattern-316874100 None] Lock "cinder-b2df3e91-e273-454e-91f0-0ea180812d20-delete_snapshot" released by "delete_snapshot" :: held 1.852s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (21a527cc-abb4-4998-8508-1818718bdef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b26f5a2-5a92-4f23-8796-650d8750d94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b26f5a2-5a92-4f23-8796-650d8750d94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1362064265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b606a927-b37a-4334-8645-f7f30ec7ecfb,host='devstack@QuobyteHD#QuobyteHD',id=4285f83e-0691-4b44-a4b2-ce4e9dde3001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:35Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7427a53f-6132-49e5-9198-6fdf3418bad4),volume_type_id=7427a53f-6132-49e5-9198-6fdf3418bad4)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129c72b2-b730-487e-93e0-33abe85d64ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129c72b2-b730-487e-93e0-33abe85d64ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9a9653-e7fd-4ba9-a388-d9a4df6b825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9a9653-e7fd-4ba9-a388-d9a4df6b825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4285f83e-0691-4b44-a4b2-ce4e9dde3001', 'volume_name': 'volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29720b8-818d-4df5-a654-e5e015a06ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29720b8-818d-4df5-a654-e5e015a06ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe8274a-3ed0-4a75-9d0a-a3420882063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Volume 4285f83e-0691-4b44-a4b2-ce4e9dde3001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001', 'volume_size': 1} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b606a927-b37a-4334-8645-f7f30ec7ecfb,created_at=2026-11-05T14:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1362064265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b606a927-b37a-4334-8645-f7f30ec7ecfb,host='devstack@QuobyteHD#QuobyteHD',id=4285f83e-0691-4b44-a4b2-ce4e9dde3001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:35Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7427a53f-6132-49e5-9198-6fdf3418bad4),volume_type_id=7427a53f-6132-49e5-9198-6fdf3418bad4)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Creating volume 4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:35 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 1073741824 Nov 05 15:17:35 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:35 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 1073741824" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:35 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 Nov 05 15:17:35 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:36 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe8274a-3ed0-4a75-9d0a-a3420882063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afbfeae-120e-4458-89ee-22763852cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Volume volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 (4285f83e-0691-4b44-a4b2-ce4e9dde3001): created successfully Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afbfeae-120e-4458-89ee-22763852cb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (21a527cc-abb4-4998-8508-1818718bdef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6d2b223f-0990-435a-a874-07bc94a00a32 tempest-GroupSnapshotsTest-1914991278 None] Created volume successfully. Nov 05 15:17:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5d1e4e08-5e27-429b-8f4c-4ad04b11b338 tempest-GroupSnapshotsTest-1914991278 None] Update group completed successfully. Nov 05 15:17:37 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=122,cinder:SELECT=107,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:17:37 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=117,cinder:UPDATE=123,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:17:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1b03ccb1-3574-4f36-8441-2e9baa89d46f tempest-GroupSnapshotsTest-1914991278 None] Update group completed successfully. Nov 05 15:17:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3fac4862-f9e5-4b36-8c4a-f9d7c91205e3 tempest-GroupSnapshotsTest-1914991278 None] Update group completed successfully. Nov 05 15:17:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-7cb10c5f-cb30-426f-b393-6564af99ca7c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Lock "cinder-7cb10c5f-cb30-426f-b393-6564af99ca7c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Acquiring lock "cinder-quobyte-7cb10c5f-cb30-426f-b393-6564af99ca7c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-7cb10c5f-cb30-426f-b393-6564af99ca7c" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eb3bef-2b96-47ab-85ce-be777da76a14]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:39 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:39 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:39 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c Nov 05 15:17:39 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:39 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:17:39 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:39 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c Nov 05 15:17:39 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:39 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7cb10c5f-cb30-426f-b393-6564af99ca7c" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Lock "cinder-quobyte-7cb10c5f-cb30-426f-b393-6564af99ca7c" released by "delete_volume" :: held 0.669s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Created reservations ['d97178fc-24a7-43fc-9e49-e55ae6839e1d', 'e7440be9-8186-450b-8d6c-401b2f876238', '5a5dad6c-b379-4f17-8ccb-4dd0e1c9345c', '36df392d-9a6e-48d6-ae9e-bc3b902e8646'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:39 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:39 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:40 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Deleted volume successfully. Nov 05 15:17:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e12a740c-5db3-4d6e-bd50-6aabe6461528 tempest-GroupSnapshotsTest-1914991278 None] Update group completed successfully. Nov 05 15:17:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49dcc259-ea67-45bd-bf84-ea60d1d733e4 tempest-TestStampPattern-316874100 None] Lock "cinder-7cb10c5f-cb30-426f-b393-6564af99ca7c-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] GroupSnapshot e26f3871-cbfc-4b08-b70b-5f3e2e4f0352: creating. Nov 05 15:17:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Group snapshot e26f3871-cbfc-4b08-b70b-5f3e2e4f0352: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 15:17:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Creating offline snapshot 12308346-66bb-4e24-9396-cd0b4251dd22 of volume 4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:17:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a07674-f6c9-4698-8a27-eab1a5486da2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:41 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 Nov 05 15:17:41 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:42 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001" returned: 0 in 0.381s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:42 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 1G Nov 05 15:17:42 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:42 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 1G" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:42 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 Nov 05 15:17:42 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:42 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22" returned: 0 in 0.321s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:42 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:42 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 Nov 05 15:17:42 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:43 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:43 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info Nov 05 15:17:43 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:43 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:43 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:43 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info Nov 05 15:17:43 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:43 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.info" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Creating offline snapshot 2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 of volume bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4db0d9-5759-4e82-8b40-2cb7be2bda13]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:43 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 Nov 05 15:17:43 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:44 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193" returned: 0 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:44 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 1G Nov 05 15:17:44 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:44 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 1G" returned: 0 in 0.482s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc972e15-cdee-4147-b47c-489d49239193 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:44 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc972e15-cdee-4147-b47c-489d49239193 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 Nov 05 15:17:44 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:44 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc972e15-cdee-4147-b47c-489d49239193 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:44 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:44 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 Nov 05 15:17:44 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:45 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:45 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info Nov 05 15:17:45 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:45 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:17:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:45 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info Nov 05 15:17:45 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:45 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.info" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d22d7067-462e-40cc-aae0-1770656245ad tempest-GroupSnapshotsTest-1914991278 None] group_snapshot e26f3871-cbfc-4b08-b70b-5f3e2e4f0352: created successfully Nov 05 15:17:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] group_snapshot e26f3871-cbfc-4b08-b70b-5f3e2e4f0352: deleting Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] group_snapshot e26f3871-cbfc-4b08-b70b-5f3e2e4f0352: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-4285f83e-0691-4b44-a4b2-ce4e9dde3001" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-4285f83e-0691-4b44-a4b2-ce4e9dde3001" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-12308346-66bb-4e24-9396-cd0b4251dd22" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-12308346-66bb-4e24-9396-cd0b4251dd22" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Deleting offline snapshot 12308346-66bb-4e24-9396-cd0b4251dd22 of volume 4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] snapshot_file for this snap is: volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f93076-4769-4922-a1d9-210bb187a33d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:46 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 Nov 05 15:17:46 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:46 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22" returned: 0 in 0.426s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6690d-a55c-4310-9ce7-2835494fac76]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:46 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 Nov 05 15:17:46 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:46 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:46 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 Nov 05 15:17:46 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:47 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:47 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22 Nov 05 15:17:47 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:47 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001.12308346-66bb-4e24-9396-cd0b4251dd22" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-12308346-66bb-4e24-9396-cd0b4251dd22" released by "_delete_snapshot" :: held 1.501s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-4285f83e-0691-4b44-a4b2-ce4e9dde3001" released by "delete_snapshot" :: held 1.531s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-bc972e15-cdee-4147-b47c-489d49239193" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-bc972e15-cdee-4147-b47c-489d49239193" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Deleting offline snapshot 2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 of volume bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] snapshot_file for this snap is: volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[32853527-d7f0-43a6-88d9-6ac6b412719f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:47 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 Nov 05 15:17:47 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:48 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc972e15-cdee-4147-b47c-489d49239193(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a2ee53-94fc-4b65-afce-5a4c3fc6d08b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:48 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 Nov 05 15:17:48 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:48 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:48 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 Nov 05 15:17:48 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:48 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:48 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48 Nov 05 15:17:48 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:49 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193.2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-2bc7771c-096d-4eb9-9190-3c1a2b9d4e48" released by "_delete_snapshot" :: held 1.488s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-bc972e15-cdee-4147-b47c-489d49239193" released by "delete_snapshot" :: held 1.510s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:49 devstack cinder-volume[87126]: WARNING cinder.quota [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1559591122 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1559591122, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:17:49 devstack cinder-volume[87126]: WARNING cinder.quota [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1559591122 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1559591122, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:17:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['072b7744-1faa-4968-be2a-c6a44e1e35e9', '758a7337-a136-4975-a979-837cae5f5480', '794d72bb-31b3-4780-86b1-a1bf1554342f', '0baea520-833a-4894-8a07-2fea7f7f9e02'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['e5231457-6d35-4224-97c2-16caa0f19da1', 'e4798010-6a98-4853-9e6d-6866fb0c7fe2', 'e2860446-5c34-43a9-99d0-a2064612f72c', '8467793f-0fcf-4158-a582-8c5a5395ed22'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ce6483be-049b-4911-8b82-5cab41223967 tempest-GroupSnapshotsTest-1914991278 None] group_snapshot e26f3871-cbfc-4b08-b70b-5f3e2e4f0352: deleted successfully Nov 05 15:17:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-4285f83e-0691-4b44-a4b2-ce4e9dde3001" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-4285f83e-0691-4b44-a4b2-ce4e9dde3001" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e3402-2052-4d9f-9da1-8ac0b6460303]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:51 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 Nov 05 15:17:51 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:51 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:51 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001 Nov 05 15:17:51 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:51 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-4285f83e-0691-4b44-a4b2-ce4e9dde3001" returned: 0 in 0.272s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-4285f83e-0691-4b44-a4b2-ce4e9dde3001" released by "delete_volume" :: held 0.762s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-bc972e15-cdee-4147-b47c-489d49239193" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-bc972e15-cdee-4147-b47c-489d49239193" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a285618e-8ef4-46a3-8996-bb0cee411681]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:51 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 Nov 05 15:17:51 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:52 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:52 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193 Nov 05 15:17:52 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:52 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bc972e15-cdee-4147-b47c-489d49239193" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-bc972e15-cdee-4147-b47c-489d49239193" released by "delete_volume" :: held 0.762s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['14ee3cbd-5e05-4f00-bd51-20f797de2b64'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:52 devstack cinder-volume[87126]: WARNING cinder.quota [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1559591122 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1559591122, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['d2f6a968-cea4-4801-a2c3-deb1128ef596', '2f786af2-6686-4695-b693-0b995bdc3f9f', '107500ad-00c8-4991-aab1-d9f6e273ef93', '57baed93-ef1f-431d-87fe-4dfe52c9ed03'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['b994a86d-d1fc-4583-922e-a7e9012ffb91', 'a21945a2-907e-4bbb-9005-c0ac4c9deacb', '2dfd1dfb-54ff-4467-9dd9-a1225eb7dab8', 'c58b68db-e1fd-459d-9f3b-4c627fec68ef'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:52 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:52 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:53 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (227e440e-43ba-4d56-a768-ac9118410a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef615d9-77d6-423d-a835-dbb876b8abb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c2063cc4-ba73-4863-bc92-9d0683d11b57 tempest-GroupSnapshotsTest-1914991278 None] Delete group completed successfully. Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef615d9-77d6-423d-a835-dbb876b8abb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332897361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5000330-cc36-4076-a2c7-1ea30f7ceddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:53Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9069a4f-a282-45f7-96a5-e9d43fde22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9069a4f-a282-45f7-96a5-e9d43fde22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992fc099-7cd4-4c78-8625-2bd825a6c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (992fc099-7cd4-4c78-8625-2bd825a6c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5000330-cc36-4076-a2c7-1ea30f7ceddd', 'volume_name': 'volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b84816d-8db5-41e3-b4b3-d77acd4117bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b84816d-8db5-41e3-b4b3-d77acd4117bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69a0029-fdc3-46b0-a06c-4a591fda4ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Volume a5000330-cc36-4076-a2c7-1ea30f7ceddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd', 'volume_size': 1} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332897361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5000330-cc36-4076-a2c7-1ea30f7ceddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:53Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Creating volume a5000330-cc36-4076-a2c7-1ea30f7ceddd {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:53 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:53 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd 1073741824 Nov 05 15:17:53 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (9a124a23-cbfd-40c0-8efe-5044ddb8d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64828989-9f3c-481e-b580-24825d448118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64828989-9f3c-481e-b580-24825d448118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892424462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4187817-24cb-48dd-b3a5-5392da8b2853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:53Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903fec23-ea41-4cea-83ee-3e9ae1dc9fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903fec23-ea41-4cea-83ee-3e9ae1dc9fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e3076e-8997-4094-bdbc-66ddb55be046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e3076e-8997-4094-bdbc-66ddb55be046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4187817-24cb-48dd-b3a5-5392da8b2853', 'volume_name': 'volume-f4187817-24cb-48dd-b3a5-5392da8b2853', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25818a9c-8c29-4715-9ab7-724be29ae677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25818a9c-8c29-4715-9ab7-724be29ae677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6041e62-1e61-416a-965e-4b6e799548ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Volume f4187817-24cb-48dd-b3a5-5392da8b2853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4187817-24cb-48dd-b3a5-5392da8b2853', 'volume_size': 1} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:53 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd 1073741824" returned: 0 in 0.617s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:53 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd Nov 05 15:17:53 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-49034ade-680d-4978-8939-cc989933886a tempest-GroupSnapshotsTest-1914991278 None] Group tempest-GroupSnapshotsTest-Group-29582259: creating Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (ce8ed5d5-505a-4c5c-b281-574c18aa7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1748f7db-24a0-4ddd-b565-ca2724bc4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1748f7db-24a0-4ddd-b565-ca2724bc4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760131348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e5f151-6227-4911-90a2-a5f50f8452db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:54Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d2d225-f73a-4433-9e91-2dce7edcacfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d2d225-f73a-4433-9e91-2dce7edcacfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e1ba1d-2d91-4402-b457-f4895a460018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e1ba1d-2d91-4402-b457-f4895a460018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e5f151-6227-4911-90a2-a5f50f8452db', 'volume_name': 'volume-c3e5f151-6227-4911-90a2-a5f50f8452db', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6801d807-7cb7-488e-b1af-deee90996ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6801d807-7cb7-488e-b1af-deee90996ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933ed79f-b141-4eb8-a8ec-badd735bd523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Volume c3e5f151-6227-4911-90a2-a5f50f8452db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e5f151-6227-4911-90a2-a5f50f8452db', 'volume_size': 1} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-49034ade-680d-4978-8939-cc989933886a tempest-GroupSnapshotsTest-1914991278 None] Group tempest-GroupSnapshotsTest-Group-29582259: created successfully Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-49034ade-680d-4978-8939-cc989933886a tempest-GroupSnapshotsTest-1914991278 None] Create group completed successfully. Nov 05 15:17:54 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1892424462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4187817-24cb-48dd-b3a5-5392da8b2853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:53Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Creating volume f4187817-24cb-48dd-b3a5-5392da8b2853 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69a0029-fdc3-46b0-a06c-4a591fda4ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd69cd-155d-4f14-b7b3-6dbd27359cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 1073741824 Nov 05 15:17:54 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Volume volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd (a5000330-cc36-4076-a2c7-1ea30f7ceddd): created successfully Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd69cd-155d-4f14-b7b3-6dbd27359cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (227e440e-43ba-4d56-a768-ac9118410a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f37fbf81-b051-4435-804c-78f8bac9aa41 tempest-CreateVolumesFromImageTest-62122492 None] Created volume successfully. Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (318865c4-94a4-4b54-960d-d110d8ac24a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2c2a01-1c3b-45ed-8214-87f510db82a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2c2a01-1c3b-45ed-8214-87f510db82a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824167164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4396e4-75a7-4f62-800a-2301eafc3f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:54Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89fbda-a221-4752-8cd1-7c4d274cf731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f89fbda-a221-4752-8cd1-7c4d274cf731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f309c18c-b96f-43ba-a938-6caa31fef3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f309c18c-b96f-43ba-a938-6caa31fef3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4396e4-75a7-4f62-800a-2301eafc3f8e', 'volume_name': 'volume-be4396e4-75a7-4f62-800a-2301eafc3f8e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21eaeb7e-a16c-4805-b4b3-b48b83fa5ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21eaeb7e-a16c-4805-b4b3-b48b83fa5ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aefa363-f8b1-4c2b-99c8-96c238bafa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Volume be4396e4-75a7-4f62-800a-2301eafc3f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4396e4-75a7-4f62-800a-2301eafc3f8e', 'volume_size': 1} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (59d8c771-b6d8-48b8-8947-1cdd8d9b9b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713671eb-6676-4525-a6ac-5accd26fbf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713671eb-6676-4525-a6ac-5accd26fbf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604902661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b4d8ec-b843-44ac-9f3e-638be73828bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:55Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcbe68c-cd28-45d9-90b6-5d9a8c4ccd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcbe68c-cd28-45d9-90b6-5d9a8c4ccd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e872c0db-f36e-4c4c-83bf-baf4480a4dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e872c0db-f36e-4c4c-83bf-baf4480a4dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b4d8ec-b843-44ac-9f3e-638be73828bd', 'volume_name': 'volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62f1908-f864-4dd9-916b-c0d643974b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62f1908-f864-4dd9-916b-c0d643974b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627e642b-97b0-4552-ac30-96fa2fef3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Volume a3b4d8ec-b843-44ac-9f3e-638be73828bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd', 'volume_size': 1} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 1073741824" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:54 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 Nov 05 15:17:54 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:54 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-760131348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e5f151-6227-4911-90a2-a5f50f8452db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:54Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Creating volume c3e5f151-6227-4911-90a2-a5f50f8452db {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6041e62-1e61-416a-965e-4b6e799548ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4187817-24cb-48dd-b3a5-5392da8b2853', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db 1073741824 Nov 05 15:17:55 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4b1c82-2fcc-4709-ac60-602d0528ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Volume volume-f4187817-24cb-48dd-b3a5-5392da8b2853 (f4187817-24cb-48dd-b3a5-5392da8b2853): created successfully Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4b1c82-2fcc-4709-ac60-602d0528ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (9a124a23-cbfd-40c0-8efe-5044ddb8d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6dacbe25-d36b-488a-b5f7-3e5ef94fa287 tempest-CreateVolumesFromImageTest-62122492 None] Created volume successfully. Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (12f71c7d-eed7-4342-b7c8-c1be522b7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac71aeb-626e-4e47-94bf-f85fdd835bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac71aeb-626e-4e47-94bf-f85fdd835bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903833413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f2c0101-c3aa-4b6f-93f7-659720cae6a0,host='devstack@QuobyteHD#QuobyteHD',id=278ff819-a8ef-492f-af88-7cc1fd244bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:55Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b17af6a-6543-4dcc-a873-3cd2363fbb02),volume_type_id=4b17af6a-6543-4dcc-a873-3cd2363fbb02)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46288ea-95b9-4f9c-bc77-69ec27306f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46288ea-95b9-4f9c-bc77-69ec27306f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40553267-f0d0-4c67-b064-2aabf5857c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40553267-f0d0-4c67-b064-2aabf5857c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278ff819-a8ef-492f-af88-7cc1fd244bbd', 'volume_name': 'volume-278ff819-a8ef-492f-af88-7cc1fd244bbd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96013837-79b9-4029-aba2-64a1093df269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96013837-79b9-4029-aba2-64a1093df269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba257a3-104a-4f03-9b62-2b72d4996c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Volume 278ff819-a8ef-492f-af88-7cc1fd244bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278ff819-a8ef-492f-af88-7cc1fd244bbd', 'volume_size': 1} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:55 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db 1073741824" returned: 0 in 0.489s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:55 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db Nov 05 15:17:55 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:55 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-824167164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4396e4-75a7-4f62-800a-2301eafc3f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:54Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Creating volume be4396e4-75a7-4f62-800a-2301eafc3f8e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933ed79f-b141-4eb8-a8ec-badd735bd523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e5f151-6227-4911-90a2-a5f50f8452db', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e 1073741824 Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7f41cb-3193-4f77-b704-d04d40ddb167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:55 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Volume volume-c3e5f151-6227-4911-90a2-a5f50f8452db (c3e5f151-6227-4911-90a2-a5f50f8452db): created successfully Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea7f41cb-3193-4f77-b704-d04d40ddb167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (ce8ed5d5-505a-4c5c-b281-574c18aa7654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e4ea7966-36b2-469d-afa5-2ee8c63f5592 tempest-CreateVolumesFromImageTest-62122492 None] Created volume successfully. Nov 05 15:17:56 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e 1073741824" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:56 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e Nov 05 15:17:56 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:56 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604902661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b4d8ec-b843-44ac-9f3e-638be73828bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8e3a34ed4e42e88c7e3b05c72bd465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:55Z,use_quota=True,user_id='bc21bdd15ee34e1caf3824912086127f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Creating volume a3b4d8ec-b843-44ac-9f3e-638be73828bd {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:56 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aefa363-f8b1-4c2b-99c8-96c238bafa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4396e4-75a7-4f62-800a-2301eafc3f8e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:56 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd 1073741824 Nov 05 15:17:56 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd3bc8b-be99-4575-a665-a731fa87366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Volume volume-be4396e4-75a7-4f62-800a-2301eafc3f8e (be4396e4-75a7-4f62-800a-2301eafc3f8e): created successfully Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd3bc8b-be99-4575-a665-a731fa87366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (318865c4-94a4-4b54-960d-d110d8ac24a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a34bd0d5-eaed-4da8-b98d-569914fadd7a tempest-CreateVolumesFromImageTest-62122492 None] Created volume successfully. Nov 05 15:17:56 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd 1073741824" returned: 0 in 0.432s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:57 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd Nov 05 15:17:57 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:57 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.795s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f2c0101-c3aa-4b6f-93f7-659720cae6a0,created_at=2026-11-05T14:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-903833413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f2c0101-c3aa-4b6f-93f7-659720cae6a0,host='devstack@QuobyteHD#QuobyteHD',id=278ff819-a8ef-492f-af88-7cc1fd244bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e45ed9b59f24a80b2e91969c69567f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:17:55Z,use_quota=True,user_id='60f432900bc04b558ca5f359f7730bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b17af6a-6543-4dcc-a873-3cd2363fbb02),volume_type_id=4b17af6a-6543-4dcc-a873-3cd2363fbb02)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Creating volume 278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:17:57 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627e642b-97b0-4552-ac30-96fa2fef3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:57 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd 1073741824 Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b26bc7e-9779-4bd2-ad19-89c5a4b56fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:57 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Volume volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd (a3b4d8ec-b843-44ac-9f3e-638be73828bd): created successfully Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b26bc7e-9779-4bd2-ad19-89c5a4b56fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Flow 'volume_create_manager' (59d8c771-b6d8-48b8-8947-1cdd8d9b9b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:57 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-88e3db76-d146-456d-9865-07ec35f80a97 tempest-CreateVolumesFromImageTest-62122492 None] Created volume successfully. Nov 05 15:17:57 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd 1073741824" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:57 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd Nov 05 15:17:57 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:57 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba257a3-104a-4f03-9b62-2b72d4996c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278ff819-a8ef-492f-af88-7cc1fd244bbd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34eff3a-f77c-40f8-9f63-8c1d19b64d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:17:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Volume volume-278ff819-a8ef-492f-af88-7cc1fd244bbd (278ff819-a8ef-492f-af88-7cc1fd244bbd): created successfully Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34eff3a-f77c-40f8-9f63-8c1d19b64d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Flow 'volume_create_manager' (12f71c7d-eed7-4342-b7c8-c1be522b7d96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:17:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9889a58e-bc3a-4ff5-bc6a-4731a16700b5 tempest-GroupSnapshotsTest-1914991278 None] Created volume successfully. Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-a3b4d8ec-b843-44ac-9f3e-638be73828bd-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-a3b4d8ec-b843-44ac-9f3e-638be73828bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-quobyte-a3b4d8ec-b843-44ac-9f3e-638be73828bd" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-a3b4d8ec-b843-44ac-9f3e-638be73828bd" acquired by "delete_volume" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd2992c-29de-46d3-a503-4ce6d58dcee2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:58 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd Nov 05 15:17:58 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:58 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:58 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd Nov 05 15:17:58 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:58 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a3b4d8ec-b843-44ac-9f3e-638be73828bd" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-a3b4d8ec-b843-44ac-9f3e-638be73828bd" released by "delete_volume" :: held 0.634s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Created reservations ['6486c2ef-aa65-4df2-bd58-0f70f27b9c3d', 'ceccbb0d-6904-4d18-b27c-4344c0d2c6c8', '562d6e1c-4323-4f9d-93af-81cd64acc68c', 'c9961bc9-b93b-4932-aa61-31ff17086f19'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:17:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:58 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:17:58 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] GroupSnapshot 3293e40b-4ea6-461b-b996-09ac813c10f5: creating. Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Group snapshot 3293e40b-4ea6-461b-b996-09ac813c10f5: creating. {{(pid=87126) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Creating offline snapshot 6eb8c343-3146-41b0-9722-95d5c5fedb6c of volume 278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:17:59 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34bf4c6-c813-4fbb-85b3-e8fcd43648d1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Deleted volume successfully. Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-67ad8c96-0c9a-45a2-a152-331028cb8457 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-a3b4d8ec-b843-44ac-9f3e-638be73828bd-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-be4396e4-75a7-4f62-800a-2301eafc3f8e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-be4396e4-75a7-4f62-800a-2301eafc3f8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:59 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd Nov 05 15:17:59 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-quobyte-be4396e4-75a7-4f62-800a-2301eafc3f8e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-be4396e4-75a7-4f62-800a-2301eafc3f8e" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce2117-5541-4432-af0e-7f539a46615c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:59 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e Nov 05 15:17:59 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:59 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd" returned: 0 in 0.403s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:59 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c 1G Nov 05 15:17:59 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:59 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:59 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e Nov 05 15:17:59 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:59 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c 1G" returned: 0 in 0.394s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278ff819-a8ef-492f-af88-7cc1fd244bbd -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:17:59 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278ff819-a8ef-492f-af88-7cc1fd244bbd -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c Nov 05 15:17:59 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:17:59 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-be4396e4-75a7-4f62-800a-2301eafc3f8e" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:17:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-be4396e4-75a7-4f62-800a-2301eafc3f8e" released by "delete_volume" :: held 0.692s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Created reservations ['3ad49fcf-e48f-45bb-8242-ace4fec55b33', '8ba147e9-acec-47d6-902d-9085ec900e9d', '494ad549-d004-4fb8-8976-179eaf0801dd', 'f3389e85-b50f-4fa3-bc1e-074b0ce6fdf5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:00 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:00 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:00 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-278ff819-a8ef-492f-af88-7cc1fd244bbd -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:00 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:00 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c Nov 05 15:18:00 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-c3e5f151-6227-4911-90a2-a5f50f8452db-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:00 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Deleted volume successfully. Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-c3e5f151-6227-4911-90a2-a5f50f8452db-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49252bb6-4859-4763-b26d-69885e8d666b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-be4396e4-75a7-4f62-800a-2301eafc3f8e-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-quobyte-c3e5f151-6227-4911-90a2-a5f50f8452db" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-c3e5f151-6227-4911-90a2-a5f50f8452db" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac86ff70-da0c-49b5-813a-506bc761e6a7]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:00 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:00 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info Nov 05 15:18:00 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:00 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db Nov 05 15:18:00 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:00 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:00 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:00 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info Nov 05 15:18:00 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:00 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:00 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db Nov 05 15:18:00 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:01 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.info" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:01 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c3e5f151-6227-4911-90a2-a5f50f8452db" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-c3e5f151-6227-4911-90a2-a5f50f8452db" released by "delete_volume" :: held 0.690s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-35bac0de-6a8c-4774-a164-1ad8bd3e2726 tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3293e40b-4ea6-461b-b996-09ac813c10f5: created successfully Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Created reservations ['52ea50c1-9fdd-42fc-a62d-2675597f3b11', '9ba89750-6ee7-49ca-8be1-d884d2d9e88c', '6d663339-7e57-48eb-9ed6-9ea5ef545a5f', 'efc3cb3b-382f-4dbc-befa-9b322418393e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:01 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:01 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3293e40b-4ea6-461b-b996-09ac813c10f5: deleting Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3293e40b-4ea6-461b-b996-09ac813c10f5: deleting {{(pid=87126) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-278ff819-a8ef-492f-af88-7cc1fd244bbd" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-278ff819-a8ef-492f-af88-7cc1fd244bbd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-6eb8c343-3146-41b0-9722-95d5c5fedb6c" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-6eb8c343-3146-41b0-9722-95d5c5fedb6c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Deleting offline snapshot 6eb8c343-3146-41b0-9722-95d5c5fedb6c of volume 278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] snapshot_file for this snap is: volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba8b10-1d8a-4a1f-a05b-458bdb14df98]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-f4187817-24cb-48dd-b3a5-5392da8b2853-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:01 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-f4187817-24cb-48dd-b3a5-5392da8b2853-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:01 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Deleted volume successfully. Nov 05 15:18:01 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c Nov 05 15:18:01 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f75de08-f95d-4e56-b1f0-d0cc21f62542 tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-c3e5f151-6227-4911-90a2-a5f50f8452db-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-quobyte-f4187817-24cb-48dd-b3a5-5392da8b2853" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-f4187817-24cb-48dd-b3a5-5392da8b2853" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6666470f-5e99-4ae7-9111-3ad7245cad64]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:01 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 Nov 05 15:18:01 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:01 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-278ff819-a8ef-492f-af88-7cc1fd244bbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2cd8c4-4109-40e2-90c9-2ddaf2f4d490]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:02 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd Nov 05 15:18:02 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:02 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853" returned: 0 in 0.370s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:02 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853 Nov 05 15:18:02 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:02 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f4187817-24cb-48dd-b3a5-5392da8b2853" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:02 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd" returned: 0 in 0.373s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-f4187817-24cb-48dd-b3a5-5392da8b2853" released by "delete_volume" :: held 0.658s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:02 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c Nov 05 15:18:02 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Created reservations ['a1adbf86-7766-424b-8267-9209aa9610dd', '64512377-2da2-4cef-8bb4-cbfe8ad33be5', '571663fe-8a39-46fa-b6e9-06083d75be15', 'fcd85b99-e6c6-45ad-92a5-9420be64b28a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:02 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:02 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:02 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:02 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c Nov 05 15:18:02 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:02 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.270s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Deleted volume successfully. Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b317ed9-6009-40fa-9805-ef3c7867b54b tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-f4187817-24cb-48dd-b3a5-5392da8b2853-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-a5000330-cc36-4076-a2c7-1ea30f7ceddd-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-a5000330-cc36-4076-a2c7-1ea30f7ceddd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "cinder-quobyte-a5000330-cc36-4076-a2c7-1ea30f7ceddd" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-a5000330-cc36-4076-a2c7-1ea30f7ceddd" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c099c10-d929-419b-b598-1ab8d5a99a8a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:03 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd.6eb8c343-3146-41b0-9722-95d5c5fedb6c" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:03 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd Nov 05 15:18:03 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-6eb8c343-3146-41b0-9722-95d5c5fedb6c" released by "_delete_snapshot" :: held 1.562s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-278ff819-a8ef-492f-af88-7cc1fd244bbd" released by "delete_snapshot" :: held 1.593s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:03 devstack cinder-volume[87126]: WARNING cinder.quota [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-441163701 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-441163701, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:03 devstack cinder-volume[87126]: WARNING cinder.quota [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-441163701 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-441163701, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['44448a26-7fba-4805-a458-b9f1e385b5f7', '781cb213-8d83-4045-99ab-c7cc6dafbd3a', '445fc9f7-84e3-42d6-beb9-44d06e9b423b', 'ba72e629-a76a-44ea-9b8e-03dc1aa790c0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bf6553e6-4849-4c80-bec8-6fd502163f6c tempest-GroupSnapshotsTest-1914991278 None] group_snapshot 3293e40b-4ea6-461b-b996-09ac813c10f5: deleted successfully Nov 05 15:18:03 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:03 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd Nov 05 15:18:03 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:03 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-a5000330-cc36-4076-a2c7-1ea30f7ceddd" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-quobyte-a5000330-cc36-4076-a2c7-1ea30f7ceddd" released by "delete_volume" :: held 0.650s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Created reservations ['0cdb3c88-42f1-45e6-8045-99e518519c32', '1946d2a8-d017-42e6-bb5a-5efde606d905', '6457ce1c-801d-4955-8fda-71e8c16de56d', 'a27edd3f-5656-4566-8f9e-b88308b58a3d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:03 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:03 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:03 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:03 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Deleted volume successfully. Nov 05 15:18:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-88a013cc-f86d-4172-9391-b8d3d228ee3f tempest-CreateVolumesFromImageTest-62122492 None] Lock "cinder-a5000330-cc36-4076-a2c7-1ea30f7ceddd-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "cinder-quobyte-278ff819-a8ef-492f-af88-7cc1fd244bbd" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-278ff819-a8ef-492f-af88-7cc1fd244bbd" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ebf623-3e2a-4aa7-a4dc-17cd2977ee8d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:04 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd Nov 05 15:18:04 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:04 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:04 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd Nov 05 15:18:04 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:04 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-278ff819-a8ef-492f-af88-7cc1fd244bbd" returned: 0 in 0.281s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Lock "cinder-quobyte-278ff819-a8ef-492f-af88-7cc1fd244bbd" released by "delete_volume" :: held 0.763s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['38a4b4a1-2f02-4f69-9c69-d1bbb17ac7c5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:04 devstack cinder-volume[87126]: WARNING cinder.quota [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-441163701 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-441163701, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:04 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Created reservations ['1a1fde50-2cdf-438f-988f-7484ded0b168', '08736a01-53b4-4726-a272-cd31c9365dd3', '439bf6dc-8c16-438c-8a14-9e2b577396f0', '614ed44c-2005-4e5f-81ba-9872c1f70909'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:05 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:05 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:05 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:05 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9295b37f-a76c-43c3-8ae6-9c6095f27586 tempest-GroupSnapshotsTest-1914991278 None] Delete group completed successfully. Nov 05 15:18:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d61c3434-e3d0-44ef-ad63-8580f07c1aac tempest-GroupsTest-1203841217 None] Group tempest-Group1-268830775: creating Nov 05 15:18:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d61c3434-e3d0-44ef-ad63-8580f07c1aac tempest-GroupsTest-1203841217 None] Group tempest-Group1-268830775: created successfully Nov 05 15:18:11 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d61c3434-e3d0-44ef-ad63-8580f07c1aac tempest-GroupsTest-1203841217 None] Create group completed successfully. Nov 05 15:18:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-84782639-d173-4b06-8ecf-782bf980daeb tempest-GroupsTest-1203841217 None] Group tempest-Group2-589748615: creating Nov 05 15:18:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-84782639-d173-4b06-8ecf-782bf980daeb tempest-GroupsTest-1203841217 None] Group tempest-Group2-589748615: created successfully Nov 05 15:18:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-84782639-d173-4b06-8ecf-782bf980daeb tempest-GroupsTest-1203841217 None] Create group completed successfully. Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Flow 'volume_create_manager' (a7de2a22-7dad-4fcc-92c1-94cbda688b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68156e4f-3177-4a40-95f5-99577690258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68156e4f-3177-4a40-95f5-99577690258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1699833744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a94a3f0-17b9-4a0a-830b-3236a3e58b43,host='devstack@QuobyteHD#QuobyteHD',id=7b02cd6e-2f00-4d79-8fe7-1ad11a26531c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc354f911f144f7bacb1336c469d21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:14Z,use_quota=True,user_id='77461651a1d04f0a969de0495923d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c92f6dd-a809-4a6d-83c5-7764b71a7027),volume_type_id=6c92f6dd-a809-4a6d-83c5-7764b71a7027)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9825f90-f877-472b-b901-196932e8a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9825f90-f877-472b-b901-196932e8a108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d64c63-294d-456d-92fc-4fad83b0f2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d64c63-294d-456d-92fc-4fad83b0f2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b02cd6e-2f00-4d79-8fe7-1ad11a26531c', 'volume_name': 'volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60af132f-9f4a-446c-9e35-4cc5b4e88e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60af132f-9f4a-446c-9e35-4cc5b4e88e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e090a641-02ca-4205-92e7-9745c5396dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Volume 7b02cd6e-2f00-4d79-8fe7-1ad11a26531c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c', 'volume_size': 1} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a94a3f0-17b9-4a0a-830b-3236a3e58b43,created_at=2026-11-05T14:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1699833744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a94a3f0-17b9-4a0a-830b-3236a3e58b43,host='devstack@QuobyteHD#QuobyteHD',id=7b02cd6e-2f00-4d79-8fe7-1ad11a26531c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc354f911f144f7bacb1336c469d21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:14Z,use_quota=True,user_id='77461651a1d04f0a969de0495923d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c92f6dd-a809-4a6d-83c5-7764b71a7027),volume_type_id=6c92f6dd-a809-4a6d-83c5-7764b71a7027)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Creating volume 7b02cd6e-2f00-4d79-8fe7-1ad11a26531c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:18:14 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:14 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c 1073741824 Nov 05 15:18:14 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:14 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c 1073741824" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:14 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c Nov 05 15:18:14 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:14 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e090a641-02ca-4205-92e7-9745c5396dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89304e8-b7fd-40c1-87b8-d24ab9dc107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Volume volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c (7b02cd6e-2f00-4d79-8fe7-1ad11a26531c): created successfully Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89304e8-b7fd-40c1-87b8-d24ab9dc107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Flow 'volume_create_manager' (a7de2a22-7dad-4fcc-92c1-94cbda688b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cbfa8f1c-9a2a-478d-a2c2-9ba42bfd2656 tempest-GroupsTest-1203841217 None] Created volume successfully. Nov 05 15:18:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Acquiring lock "cinder-quobyte-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Lock "cinder-quobyte-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc5aea3-b2cc-4e15-be49-3acf8a3a68ba]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:15 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c Nov 05 15:18:15 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:16 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:16 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c Nov 05 15:18:16 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:16 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Lock "cinder-quobyte-7b02cd6e-2f00-4d79-8fe7-1ad11a26531c" released by "delete_volume" :: held 0.645s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Created reservations ['4803926f-d0b4-4b62-98ba-8ca12b5ff902'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:16 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1574088984 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1574088984, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:16 devstack cinder-volume[87126]: WARNING cinder.quota [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1574088984 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1574088984, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Created reservations ['49325fa9-88cf-4f3e-86e3-7ff13fbdfa47', '771fcd97-36d7-472c-b9bf-8ff3ab750fd7', '06f4b346-05f2-4d81-92f9-606431da8d71', '04007d3b-a60b-4bb3-8e28-77a8b2f20d24'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:16 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:16 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:16 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2ad1c8e5-6c92-4fae-8ac7-9c0b5dbb58a7 tempest-GroupsTest-1203841217 None] Delete group completed successfully. Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Created reservations ['cc2519a1-f2c8-4fc9-abd7-52519b7521d1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:17 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:17 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:17 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:17 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-79648480-30e4-486a-8fb9-5f7f22e89e55 tempest-GroupsTest-1203841217 None] Delete group completed successfully. Nov 05 15:18:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67a18aca-0210-4573-a12e-cdff00d709ee tempest-GroupsTest-1203841217 None] Group tempest-GroupsTest-Group-865564106: creating Nov 05 15:18:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67a18aca-0210-4573-a12e-cdff00d709ee tempest-GroupsTest-1203841217 None] Group tempest-GroupsTest-Group-865564106: created successfully Nov 05 15:18:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-67a18aca-0210-4573-a12e-cdff00d709ee tempest-GroupsTest-1203841217 None] Create group completed successfully. Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Flow 'volume_create_manager' (f97904c5-1cd1-4981-b212-97d36cda84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478ec685-84f3-4109-900a-000f60957b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478ec685-84f3-4109-900a-000f60957b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656662296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d70cfda3-dcf0-4405-a7b8-247ac54968ea,host='devstack@QuobyteHD#QuobyteHD',id=8df48229-a8df-4c75-835f-90562796272a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc354f911f144f7bacb1336c469d21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:20Z,use_quota=True,user_id='77461651a1d04f0a969de0495923d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83953956-6e51-4bde-9ad3-351b8d9257bb),volume_type_id=83953956-6e51-4bde-9ad3-351b8d9257bb)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ead86c-d2e2-4a61-9c98-2af547bb0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ead86c-d2e2-4a61-9c98-2af547bb0e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716ec052-afbd-4cd8-af70-43b5a88a93a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716ec052-afbd-4cd8-af70-43b5a88a93a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8df48229-a8df-4c75-835f-90562796272a', 'volume_name': 'volume-8df48229-a8df-4c75-835f-90562796272a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ebe451-0c3a-4aa3-8880-df0a5fe9e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ebe451-0c3a-4aa3-8880-df0a5fe9e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc63922-e26c-4005-a815-9335858fd100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Volume 8df48229-a8df-4c75-835f-90562796272a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8df48229-a8df-4c75-835f-90562796272a', 'volume_size': 1} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d70cfda3-dcf0-4405-a7b8-247ac54968ea,created_at=2026-11-05T14:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656662296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d70cfda3-dcf0-4405-a7b8-247ac54968ea,host='devstack@QuobyteHD#QuobyteHD',id=8df48229-a8df-4c75-835f-90562796272a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc354f911f144f7bacb1336c469d21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:20Z,use_quota=True,user_id='77461651a1d04f0a969de0495923d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83953956-6e51-4bde-9ad3-351b8d9257bb),volume_type_id=83953956-6e51-4bde-9ad3-351b8d9257bb)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Creating volume 8df48229-a8df-4c75-835f-90562796272a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:18:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:20 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a 1073741824 Nov 05 15:18:20 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:20 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a 1073741824" returned: 0 in 0.393s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:20 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a Nov 05 15:18:20 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:20 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc63922-e26c-4005-a815-9335858fd100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df48229-a8df-4c75-835f-90562796272a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8650bb4d-ac7b-47a9-bbf2-3399d6ea8829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Volume volume-8df48229-a8df-4c75-835f-90562796272a (8df48229-a8df-4c75-835f-90562796272a): created successfully Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8650bb4d-ac7b-47a9-bbf2-3399d6ea8829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Flow 'volume_create_manager' (f97904c5-1cd1-4981-b212-97d36cda84c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1b81fe11-6fc5-4904-9d44-78a576501358 tempest-GroupsTest-1203841217 None] Created volume successfully. Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Flow 'volume_create_manager' (f4aa8ecb-f995-4b82-bf58-67e884ff2577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab9d3f1-fba2-4d25-95de-807a78955708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fab9d3f1-fba2-4d25-95de-807a78955708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202232826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d70cfda3-dcf0-4405-a7b8-247ac54968ea,host='devstack@QuobyteHD#QuobyteHD',id=d69d42bd-fa7f-4d9b-b475-5039bd567ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc354f911f144f7bacb1336c469d21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:22Z,use_quota=True,user_id='77461651a1d04f0a969de0495923d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83953956-6e51-4bde-9ad3-351b8d9257bb),volume_type_id=83953956-6e51-4bde-9ad3-351b8d9257bb)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c00b705-2c40-4c9b-b113-041603d054f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c00b705-2c40-4c9b-b113-041603d054f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4012a8b5-effe-42eb-9b77-fcc256ad2c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4012a8b5-effe-42eb-9b77-fcc256ad2c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69d42bd-fa7f-4d9b-b475-5039bd567ca5', 'volume_name': 'volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ca7624-9c28-4e97-9e36-0e345648bb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ca7624-9c28-4e97-9e36-0e345648bb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40e587d-c0b9-4c33-b424-714d895ea4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Volume d69d42bd-fa7f-4d9b-b475-5039bd567ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5', 'volume_size': 1} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d70cfda3-dcf0-4405-a7b8-247ac54968ea,created_at=2026-11-05T14:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202232826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d70cfda3-dcf0-4405-a7b8-247ac54968ea,host='devstack@QuobyteHD#QuobyteHD',id=d69d42bd-fa7f-4d9b-b475-5039bd567ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adc354f911f144f7bacb1336c469d21e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:22Z,use_quota=True,user_id='77461651a1d04f0a969de0495923d66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83953956-6e51-4bde-9ad3-351b8d9257bb),volume_type_id=83953956-6e51-4bde-9ad3-351b8d9257bb)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Creating volume d69d42bd-fa7f-4d9b-b475-5039bd567ca5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:18:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:18:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:21 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 1073741824 Nov 05 15:18:21 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:22 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 1073741824" returned: 0 in 0.405s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:22 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 Nov 05 15:18:22 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:22 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5" returned: 0 in 0.237s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40e587d-c0b9-4c33-b424-714d895ea4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ec22e6-cef0-4d23-97d6-99b129b26a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Volume volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 (d69d42bd-fa7f-4d9b-b475-5039bd567ca5): created successfully Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ec22e6-cef0-4d23-97d6-99b129b26a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Flow 'volume_create_manager' (f4aa8ecb-f995-4b82-bf58-67e884ff2577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f2bd0d6e-4795-456a-b243-12581aac9cb3 tempest-GroupsTest-1203841217 None] Created volume successfully. Nov 05 15:18:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-46200fdb-de44-410c-a8e1-ef4b37596ea4 tempest-GroupsTest-1203841217 None] Update group completed successfully. Nov 05 15:18:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-39c871ce-9e39-496b-8670-910ce12d1a00 tempest-GroupsTest-1203841217 None] Update group completed successfully. Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Acquiring lock "cinder-quobyte-8df48229-a8df-4c75-835f-90562796272a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Lock "cinder-quobyte-8df48229-a8df-4c75-835f-90562796272a" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff37ba-1ef6-4d20-91dd-b519572cc4ac]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:26 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a Nov 05 15:18:26 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:26 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a" returned: 0 in 0.355s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:26 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a Nov 05 15:18:26 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:26 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-8df48229-a8df-4c75-835f-90562796272a" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Lock "cinder-quobyte-8df48229-a8df-4c75-835f-90562796272a" released by "delete_volume" :: held 0.646s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Acquiring lock "cinder-quobyte-d69d42bd-fa7f-4d9b-b475-5039bd567ca5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Lock "cinder-quobyte-d69d42bd-fa7f-4d9b-b475-5039bd567ca5" acquired by "delete_volume" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[856b255c-72db-4d10-806d-e57d4e3fc6a6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:26 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 Nov 05 15:18:26 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:27 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:27 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5 Nov 05 15:18:27 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:27 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d69d42bd-fa7f-4d9b-b475-5039bd567ca5" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Lock "cinder-quobyte-d69d42bd-fa7f-4d9b-b475-5039bd567ca5" released by "delete_volume" :: held 0.672s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Created reservations ['27253129-9b92-4498-a7a5-c3f630c3e959'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:27 devstack cinder-volume[87126]: WARNING cinder.quota [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-257185336 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-257185336, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:27 devstack cinder-volume[87126]: WARNING cinder.quota [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-257185336 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-257185336, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Created reservations ['d7ac43fb-9cab-44ec-bd2e-48f501b7c912', '6b84a037-d9d0-4dbb-8987-2de5f3ccfad5', '09a1af31-4c87-45ac-b5ed-99ffba139299', 'f8786514-a779-47e2-bf4d-9aacf6a73884'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Created reservations ['56fd0772-1e18-4bcd-8145-068e52745aae', '9f846db8-7763-4d17-8218-9bebdd93f86b', 'b51faf29-c8ca-4028-b56b-dc3bc49e0fc0', '8a8e8fc9-ce88-4666-a539-d9863c289c18'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:27 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:27 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:27 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.233s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:27 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-704c236a-1774-4457-a589-7c8f5b865996 tempest-GroupsTest-1203841217 None] Delete group completed successfully. Nov 05 15:18:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f195b8a2-d5c6-4994-91fd-899061ca34d2 tempest-GroupsV314Test-278671990 None] Group tempest-GroupsV314Test-Group-1646927350: creating Nov 05 15:18:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f195b8a2-d5c6-4994-91fd-899061ca34d2 tempest-GroupsV314Test-278671990 None] Group tempest-GroupsV314Test-Group-1646927350: created successfully Nov 05 15:18:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f195b8a2-d5c6-4994-91fd-899061ca34d2 tempest-GroupsV314Test-278671990 None] Create group completed successfully. Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Flow 'volume_create_manager' (d0f4d89f-29ef-484f-acc5-8d59e99ade54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f12ea1e-ba81-4d3d-afff-1bcad8f0751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f12ea1e-ba81-4d3d-afff-1bcad8f0751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756305800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1447ddae-68bb-46dd-9538-89ae3a4f3176,host='devstack@QuobyteHD#QuobyteHD',id=98bb406d-a473-4b4c-a34e-638cba65b8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5baadf0deeb948728bda1dd013939fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:35Z,use_quota=True,user_id='fe7d74bb12d1491c9fcc42cfe0eeb3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b956c975-9f10-43b7-b57d-2fb640f39122),volume_type_id=b956c975-9f10-43b7-b57d-2fb640f39122)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0d655c-f374-4b6f-847f-ab95a59a2680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0d655c-f374-4b6f-847f-ab95a59a2680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9b7627-4f1d-4b27-813f-fa96eb797b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9b7627-4f1d-4b27-813f-fa96eb797b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98bb406d-a473-4b4c-a34e-638cba65b8ca', 'volume_name': 'volume-98bb406d-a473-4b4c-a34e-638cba65b8ca', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6604a3ec-75d4-4e3b-86a5-f1b7971663da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6604a3ec-75d4-4e3b-86a5-f1b7971663da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756b0af9-7607-4587-b032-ffc3ee5d9428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Volume 98bb406d-a473-4b4c-a34e-638cba65b8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98bb406d-a473-4b4c-a34e-638cba65b8ca', 'volume_size': 1} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1447ddae-68bb-46dd-9538-89ae3a4f3176,created_at=2026-11-05T14:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756305800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1447ddae-68bb-46dd-9538-89ae3a4f3176,host='devstack@QuobyteHD#QuobyteHD',id=98bb406d-a473-4b4c-a34e-638cba65b8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5baadf0deeb948728bda1dd013939fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:35Z,use_quota=True,user_id='fe7d74bb12d1491c9fcc42cfe0eeb3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b956c975-9f10-43b7-b57d-2fb640f39122),volume_type_id=b956c975-9f10-43b7-b57d-2fb640f39122)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Creating volume 98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:18:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:35 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca 1073741824 Nov 05 15:18:35 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:35 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca 1073741824" returned: 0 in 0.403s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:35 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca Nov 05 15:18:35 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:35 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756b0af9-7607-4587-b032-ffc3ee5d9428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98bb406d-a473-4b4c-a34e-638cba65b8ca', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0e3f1c-ea59-4304-9a13-c72131dcdc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Volume volume-98bb406d-a473-4b4c-a34e-638cba65b8ca (98bb406d-a473-4b4c-a34e-638cba65b8ca): created successfully Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0e3f1c-ea59-4304-9a13-c72131dcdc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Flow 'volume_create_manager' (d0f4d89f-29ef-484f-acc5-8d59e99ade54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-656b3caf-a040-4d6b-b52f-957a59c9e0a9 tempest-GroupsV314Test-278671990 None] Created volume successfully. Nov 05 15:18:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Cloning volume 98bb406d-a473-4b4c-a34e-638cba65b8ca to volume 10669297-454a-4889-aa2f-073b9b7581c1 Nov 05 15:18:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Creating offline snapshot e0559b74-9453-4420-b2df-5cb3b4bc5633 of volume 98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:18:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[01196b59-d71c-46ce-8c12-542f846373e4]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:36 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca Nov 05 15:18:36 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:37 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:37 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 1G Nov 05 15:18:37 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:37 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 1G" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98bb406d-a473-4b4c-a34e-638cba65b8ca -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:37 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98bb406d-a473-4b4c-a34e-638cba65b8ca -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 Nov 05 15:18:37 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:37 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98bb406d-a473-4b4c-a34e-638cba65b8ca -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633" returned: 0 in 0.275s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:18:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:37 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 Nov 05 15:18:37 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:38 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=155,cinder:UPDATE=166,cinder:INSERT=36,cinder:DELETE=6 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=149,cinder:UPDATE=181,cinder:INSERT=43,cinder:DELETE=10 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:38 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info Nov 05 15:18:38 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:38 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:38 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:38 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info Nov 05 15:18:38 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:38 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.info" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Acquiring lock "cinder-quobyte-10669297-454a-4889-aa2f-073b9b7581c1" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-10669297-454a-4889-aa2f-073b9b7581c1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] snapshot: e0559b74-9453-4420-b2df-5cb3b4bc5633, volume: 10669297-454a-4889-aa2f-073b9b7581c1, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f93403-5a6d-4875-b65f-5972ad8561f5]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:38 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 Nov 05 15:18:38 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:38 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98bb406d-a473-4b4c-a34e-638cba65b8ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[193e46a6-a539-4ba5-8f79-586929adbb80]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:18:39 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca Nov 05 15:18:39 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:39 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca" returned: 0 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:18:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:39 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 Nov 05 15:18:39 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:45 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1" returned: 0 in 5.711s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:18:45 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Converted 1024.00 MB image at 179.26 MB/s Nov 05 15:18:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:45 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 Nov 05 15:18:45 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:45 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-10669297-454a-4889-aa2f-073b9b7581c1" released by "_copy_volume_from_snapshot" :: held 6.751s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Acquiring lock "cinder-quobyte-e0559b74-9453-4420-b2df-5cb3b4bc5633" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-e0559b74-9453-4420-b2df-5cb3b4bc5633" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Deleting offline snapshot e0559b74-9453-4420-b2df-5cb3b4bc5633 of volume 98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] snapshot_file for this snap is: volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b6268-bb8e-49d4-9782-7975c6dd3911]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:45 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 Nov 05 15:18:45 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:45 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98bb406d-a473-4b4c-a34e-638cba65b8ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf2fc7-dbd3-422d-bbb8-0d9d252e156e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:45 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca Nov 05 15:18:45 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:46 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca" returned: 0 in 0.529s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:46 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 Nov 05 15:18:46 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:46 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633" returned: 0 in 0.334s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:46 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633 Nov 05 15:18:46 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:46 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca.e0559b74-9453-4420-b2df-5cb3b4bc5633" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-e0559b74-9453-4420-b2df-5cb3b4bc5633" released by "_delete_snapshot" :: held 1.557s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.238s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-23dd5297-f40e-4ef4-8a99-ebb7f1fd5af8 tempest-GroupsV314Test-278671990 None] Create group from source-group-1447ddae-68bb-46dd-9538-89ae3a4f3176 completed successfully. Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Acquiring lock "cinder-quobyte-10669297-454a-4889-aa2f-073b9b7581c1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-10669297-454a-4889-aa2f-073b9b7581c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b7a0bc-a9a2-4940-b0be-5b38e930fbb8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:48 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 Nov 05 15:18:48 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:48 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1" returned: 0 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:48 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1 Nov 05 15:18:48 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:48 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-10669297-454a-4889-aa2f-073b9b7581c1" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-10669297-454a-4889-aa2f-073b9b7581c1" released by "delete_volume" :: held 0.633s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Created reservations ['a96dfcd1-1d07-4c53-a36d-5e9caa0183bb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:48 devstack cinder-volume[87126]: WARNING cinder.quota [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1365360798 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1365360798, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:48 devstack cinder-volume[87126]: WARNING cinder.quota [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1365360798 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1365360798, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:18:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Created reservations ['04f0af05-c80b-4cf9-90e6-36f204a09627', '875837a0-d7ab-4f98-9820-95f1dfab183a', '37442452-57af-46d3-8ae3-320753a39dce', 'a9706b5f-64e9-4b53-b48e-46143e8172ae'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:49 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:49 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:49 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d2998d1b-250c-4570-bb4a-e479a23fa5d2 tempest-GroupsV314Test-278671990 None] Delete group completed successfully. Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Acquiring lock "cinder-quobyte-98bb406d-a473-4b4c-a34e-638cba65b8ca" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-98bb406d-a473-4b4c-a34e-638cba65b8ca" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061461c-f370-44f3-bc8f-0b8be50476c2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:49 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca Nov 05 15:18:49 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:50 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:50 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca Nov 05 15:18:50 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:50 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98bb406d-a473-4b4c-a34e-638cba65b8ca" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Lock "cinder-quobyte-98bb406d-a473-4b4c-a34e-638cba65b8ca" released by "delete_volume" :: held 0.653s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Created reservations ['cf7d5c97-c2cf-4e18-93d9-96c138678eed'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Created reservations ['e35b4e91-92ef-496f-94f7-28096b840fcd', '10bb50e8-ce1a-4936-b2f0-4d15bfdd170d', '1c12d0bb-ab7c-47e2-b114-cf47a5833f43', 'a050551d-7642-42a5-892d-642c19f9fe35'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:50 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:50 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:50 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6e796cea-f649-4c9b-8bbf-7c5a208a6012 tempest-GroupsV314Test-278671990 None] Delete group completed successfully. Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Flow 'volume_create_manager' (64c749a2-6c10-4fcf-870d-dd9ac05e2886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562014fe-2a6b-4b0e-8366-3a8595742143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562014fe-2a6b-4b0e-8366-3a8595742143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-388685729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbb1c7d-d1fe-4390-be94-48276a7277e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f736b72225df4c23a2a2d0b6ce59d2ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:56Z,use_quota=True,user_id='9b55b1f138a94471852966a68b16455a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba92dbf9-7a43-4ede-bbda-260f5305e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba92dbf9-7a43-4ede-bbda-260f5305e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178a5ef1-b4ac-420d-8ae0-632385eee056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178a5ef1-b4ac-420d-8ae0-632385eee056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbb1c7d-d1fe-4390-be94-48276a7277e0', 'volume_name': 'volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dbb491-c6aa-48ae-bc04-8ef912f89e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71dbb491-c6aa-48ae-bc04-8ef912f89e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e035e3-5ecc-4eea-90c4-0a54980d0fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Volume 5dbb1c7d-d1fe-4390-be94-48276a7277e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0', 'volume_size': 1} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-388685729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbb1c7d-d1fe-4390-be94-48276a7277e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f736b72225df4c23a2a2d0b6ce59d2ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:18:56Z,use_quota=True,user_id='9b55b1f138a94471852966a68b16455a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Creating volume 5dbb1c7d-d1fe-4390-be94-48276a7277e0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:18:56 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:56 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 1073741824 Nov 05 15:18:56 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:56 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 1073741824" returned: 0 in 0.419s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:56 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 Nov 05 15:18:56 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:56 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e035e3-5ecc-4eea-90c4-0a54980d0fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9f8f0c-8117-4e22-93d5-9a6dca31d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:18:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Volume volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 (5dbb1c7d-d1fe-4390-be94-48276a7277e0): created successfully Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9f8f0c-8117-4e22-93d5-9a6dca31d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:18:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Flow 'volume_create_manager' (64c749a2-6c10-4fcf-870d-dd9ac05e2886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:18:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-06c8f675-5a67-4426-a79b-b5599366f1ac tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Created volume successfully. Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Acquiring lock "cinder-5dbb1c7d-d1fe-4390-be94-48276a7277e0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "cinder-5dbb1c7d-d1fe-4390-be94-48276a7277e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Acquiring lock "cinder-quobyte-5dbb1c7d-d1fe-4390-be94-48276a7277e0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "cinder-quobyte-5dbb1c7d-d1fe-4390-be94-48276a7277e0" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c45f7-20bd-4e28-aa2c-dac6798d1054]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:58 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 Nov 05 15:18:58 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:58 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:58 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0 Nov 05 15:18:58 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:58 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5dbb1c7d-d1fe-4390-be94-48276a7277e0" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "cinder-quobyte-5dbb1c7d-d1fe-4390-be94-48276a7277e0" released by "delete_volume" :: held 0.654s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Created reservations ['6b5ceb9e-eba2-4fd3-a645-dc770fec3423', '8c044189-5626-4e44-9ffa-f327495d3e18', '110795db-770f-43b7-b763-36605549e6d6', '7db64cd5-de8b-4ef6-8174-106a793e43af'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:18:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:18:58 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:18:58 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:18:59 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 05 15:18:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:18:59 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:18:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Deleted volume successfully. Nov 05 15:18:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f41d9772-4fe4-4a4c-bbb8-e4d5492347d8 tempest-VolumeQuotasNegativeTestJSON-1079230246 None] Lock "cinder-5dbb1c7d-d1fe-4390-be94-48276a7277e0-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:04 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:19:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Flow 'volume_create_manager' (21f14ae4-364c-4424-9fcd-32e658519db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f04ba1f-cc6b-4898-876e-578fb8ccb30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f04ba1f-cc6b-4898-876e-578fb8ccb30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1139609585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5070607f-1f45-441f-a008-2d09e30dd336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911e386c520c4d87927ba6ae633c6ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:05Z,use_quota=True,user_id='bb5714e758344d8a83acb10f36345e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed500a4-ef1f-41ca-ab35-386a61397c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed500a4-ef1f-41ca-ab35-386a61397c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a4602c-57c1-4efe-a227-941ed77332b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a4602c-57c1-4efe-a227-941ed77332b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5070607f-1f45-441f-a008-2d09e30dd336', 'volume_name': 'volume-5070607f-1f45-441f-a008-2d09e30dd336', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43083405-6959-4c8d-8c5b-d42eb441c8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43083405-6959-4c8d-8c5b-d42eb441c8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3217dbf8-e4e9-4f34-be7c-6cf699037536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Volume 5070607f-1f45-441f-a008-2d09e30dd336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5070607f-1f45-441f-a008-2d09e30dd336', 'volume_size': 1} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1139609585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5070607f-1f45-441f-a008-2d09e30dd336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='911e386c520c4d87927ba6ae633c6ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:05Z,use_quota=True,user_id='bb5714e758344d8a83acb10f36345e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Creating volume 5070607f-1f45-441f-a008-2d09e30dd336 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:19:05 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:05 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 1073741824 Nov 05 15:19:05 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:05 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 1073741824" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:05 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 Nov 05 15:19:05 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:05 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3217dbf8-e4e9-4f34-be7c-6cf699037536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5070607f-1f45-441f-a008-2d09e30dd336', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831f90c0-f4e1-43d1-87b4-765eba2eff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:05 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Volume volume-5070607f-1f45-441f-a008-2d09e30dd336 (5070607f-1f45-441f-a008-2d09e30dd336): created successfully Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (831f90c0-f4e1-43d1-87b4-765eba2eff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:05 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Flow 'volume_create_manager' (21f14ae4-364c-4424-9fcd-32e658519db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:05 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-191cb5a0-fde0-4306-96b4-c8556a3c17dd tempest-VolumesServicesTestJSON-1345453827 None] Created volume successfully. Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Acquiring lock "cinder-5070607f-1f45-441f-a008-2d09e30dd336-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Lock "cinder-5070607f-1f45-441f-a008-2d09e30dd336-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Acquiring lock "cinder-quobyte-5070607f-1f45-441f-a008-2d09e30dd336" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Lock "cinder-quobyte-5070607f-1f45-441f-a008-2d09e30dd336" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7d75c-4f1c-4e0c-bd81-29d0aeec09ba]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:06 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 Nov 05 15:19:06 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:06 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:06 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336 Nov 05 15:19:06 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:06 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5070607f-1f45-441f-a008-2d09e30dd336" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Lock "cinder-quobyte-5070607f-1f45-441f-a008-2d09e30dd336" released by "delete_volume" :: held 0.628s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Created reservations ['9cd45519-6ed5-4a73-b3e6-4c7c1abaa405', 'd0c3c43d-d977-4ca5-8a1b-f9a41e573c0d', '811139f5-96e2-48e0-9753-a13e6901a955', 'e72f5a75-c26f-4426-80bc-6c1314f083db'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:06 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:19:06 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:07 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.237s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:07 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:19:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Deleted volume successfully. Nov 05 15:19:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a2d7705c-e2ee-4216-9359-18bc8db96e2c tempest-VolumesServicesTestJSON-1345453827 None] Lock "cinder-5070607f-1f45-441f-a008-2d09e30dd336-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:16 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=44,cinder:SELECT=33,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=33,cinder:UPDATE=50,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Flow 'volume_create_manager' (fd0a5c86-eb34-4c11-8a09-97296fb48fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f062d172-9eb1-4026-b49a-a8edbf9da5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f062d172-9eb1-4026-b49a-a8edbf9da5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1561864735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f0774e-fd07-41fc-9f70-6608cfb228cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad819423334a09884f9fb273823dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:17Z,use_quota=True,user_id='23702f1a2d224606909df72b17a59994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6d65ae-6efb-44e4-a93d-a7d65e5065b9),volume_type_id=7b6d65ae-6efb-44e4-a93d-a7d65e5065b9)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0626a5f-1f26-41ac-9d25-cf34e3af8163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0626a5f-1f26-41ac-9d25-cf34e3af8163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c383bc3-51d4-47f3-b41d-f8a9fada3b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c383bc3-51d4-47f3-b41d-f8a9fada3b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f0774e-fd07-41fc-9f70-6608cfb228cc', 'volume_name': 'volume-38f0774e-fd07-41fc-9f70-6608cfb228cc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd97bc9-16a9-4b9e-b7e8-c07e6e68d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd97bc9-16a9-4b9e-b7e8-c07e6e68d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8ab377-137b-447e-bb8f-6f6741b51f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Volume 38f0774e-fd07-41fc-9f70-6608cfb228cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f0774e-fd07-41fc-9f70-6608cfb228cc', 'volume_size': 1} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1561864735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f0774e-fd07-41fc-9f70-6608cfb228cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ad819423334a09884f9fb273823dee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:17Z,use_quota=True,user_id='23702f1a2d224606909df72b17a59994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b6d65ae-6efb-44e4-a93d-a7d65e5065b9),volume_type_id=7b6d65ae-6efb-44e4-a93d-a7d65e5065b9)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Creating volume 38f0774e-fd07-41fc-9f70-6608cfb228cc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:19:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:17 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc 1073741824 Nov 05 15:19:17 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:17 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc 1073741824" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:17 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc Nov 05 15:19:17 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:18 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc" returned: 0 in 0.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8ab377-137b-447e-bb8f-6f6741b51f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f0774e-fd07-41fc-9f70-6608cfb228cc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ce342e-c6f4-46cd-86b7-dce912fe82fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Volume volume-38f0774e-fd07-41fc-9f70-6608cfb228cc (38f0774e-fd07-41fc-9f70-6608cfb228cc): created successfully Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ce342e-c6f4-46cd-86b7-dce912fe82fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Flow 'volume_create_manager' (fd0a5c86-eb34-4c11-8a09-97296fb48fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ab1600ec-ed0f-4424-8ec5-31165b1bb7ca tempest-VolumeTypesAccessTest-2094435572 None] Created volume successfully. Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Acquiring lock "cinder-38f0774e-fd07-41fc-9f70-6608cfb228cc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Lock "cinder-38f0774e-fd07-41fc-9f70-6608cfb228cc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Acquiring lock "cinder-quobyte-38f0774e-fd07-41fc-9f70-6608cfb228cc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Lock "cinder-quobyte-38f0774e-fd07-41fc-9f70-6608cfb228cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1dc83-e116-4ce9-8dd5-65b3d46cb6f5]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:18 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc Nov 05 15:19:18 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:18 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:18 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc Nov 05 15:19:18 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:19 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-38f0774e-fd07-41fc-9f70-6608cfb228cc" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Lock "cinder-quobyte-38f0774e-fd07-41fc-9f70-6608cfb228cc" released by "delete_volume" :: held 0.631s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:19 devstack cinder-volume[87126]: WARNING cinder.quota [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1019429068 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1019429068, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:19:19 devstack cinder-volume[87126]: WARNING cinder.quota [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1019429068 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1019429068, it is now deprecated. Please use the default quota class for default quota. Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Created reservations ['46fde91a-7359-428e-844e-a6f9170da2ff', 'f715d9fd-0880-4f19-95f1-63022c40614d', 'c00e5229-28b5-4103-8fdf-f605682d3d8b', '3fa5766f-87e0-4b2c-afae-8791f7d01b3b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:19 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:19:19 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:19 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:19:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Deleted volume successfully. Nov 05 15:19:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-49b9fd9c-454f-464f-a1c9-cc04f3d40c74 tempest-VolumeTypesAccessTest-2094435572 None] Lock "cinder-38f0774e-fd07-41fc-9f70-6608cfb228cc-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:19:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=9,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Flow 'volume_create_manager' (cf426e2b-93f7-4f28-bf29-0535f9b6c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40811f9-2f2b-4e94-a3fb-fef457b4db60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40811f9-2f2b-4e94-a3fb-fef457b4db60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1228513084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26be8199-df48-4e55-9062-97e47a673dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012643084347422da91a4e49fcd9d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:34Z,use_quota=True,user_id='6d05239ddfb44b42a4708450c6945916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3458720c-eb1e-4174-9917-1bb654af6f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3458720c-eb1e-4174-9917-1bb654af6f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f38dc3-7c2d-4754-bc08-a15e2a418470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:33 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f38dc3-7c2d-4754-bc08-a15e2a418470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26be8199-df48-4e55-9062-97e47a673dd9', 'volume_name': 'volume-26be8199-df48-4e55-9062-97e47a673dd9', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35742844-1a84-46ab-b843-01468a313213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35742844-1a84-46ab-b843-01468a313213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9e0bf2-a078-4f9d-9c8e-5f8a512d3d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Volume 26be8199-df48-4e55-9062-97e47a673dd9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26be8199-df48-4e55-9062-97e47a673dd9', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Trying to clone 26be8199-df48-4e55-9062-97e47a673dd9 from image a5728ae6-576a-47f4-a55c-199ed63578be at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:19:34 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Image download 20.69 MB at 20.69 MB/s Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dba274b-a9e4-4034-89d1-a3fd7309724a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:34 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD Nov 05 15:19:34 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:34 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be is fetched for user 6d05239ddfb44b42a4708450c6945916. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a8bd5-f347-4c7f-b04d-fa6601ca2c68]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:34 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD Nov 05 15:19:34 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:35 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1228513084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26be8199-df48-4e55-9062-97e47a673dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012643084347422da91a4e49fcd9d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:34Z,use_quota=True,user_id='6d05239ddfb44b42a4708450c6945916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Creating volume 26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:19:35 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:35 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 1073741824 Nov 05 15:19:35 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:35 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 1073741824" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:35 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 Nov 05 15:19:35 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:35 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Attempting download of a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume 26be8199-df48-4e55-9062-97e47a673dd9. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f9aeb1-4b11-4f19-b93d-5c95a46e5973]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:36 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw Nov 05 15:19:36 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:36 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw" returned: 0 in 0.319s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:36 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw Nov 05 15:19:36 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:36 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw" returned: 1 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5728ae6-576a-47f4-a55c-199ed63578be_tdg0_0sw' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6587adc9-6332-4cd0-b442-bb37745d8c9f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:36 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD Nov 05 15:19:36 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:36 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] a5728ae6-576a-47f4-a55c-199ed63578be was qcow2, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:19:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:36 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 Nov 05 15:19:36 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:38 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9" returned: 0 in 1.697s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5728ae6-576a-47f4-a55c-199ed63578be_l69pe0bqdevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:19:38 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Converted 112.00 MB image at 65.93 MB/s Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:38 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 1G Nov 05 15:19:38 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:38 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 1G" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Downloaded image a5728ae6-576a-47f4-a55c-199ed63578be ((None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}])) to volume 26be8199-df48-4e55-9062-97e47a673dd9 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Temporary image a5728ae6-576a-47f4-a55c-199ed63578be for user 6d05239ddfb44b42a4708450c6945916 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:19:38 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Marking volume 26be8199-df48-4e55-9062-97e47a673dd9 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Copying metadata from image a5728ae6-576a-47f4-a55c-199ed63578be to 26be8199-df48-4e55-9062-97e47a673dd9. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Creating volume glance metadata for volume 26be8199-df48-4e55-9062-97e47a673dd9 backed by image a5728ae6-576a-47f4-a55c-199ed63578be with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9e0bf2-a078-4f9d-9c8e-5f8a512d3d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26be8199-df48-4e55-9062-97e47a673dd9', 'volume_size': 1, 'image_id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5728ae6-576a-47f4-a55c-199ed63578be', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1fcf1d3a727a4b3791994149aa634e53', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a5728ae6-576a-47f4-a55c-199ed63578be', 'created_at': datetime.datetime(2026, 11, 5, 13, 55, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 13, 55, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5728ae6-576a-47f4-a55c-199ed63578be/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0addcf7a-aaeb-4ae8-b797-15dbb9d2b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Volume volume-26be8199-df48-4e55-9062-97e47a673dd9 (26be8199-df48-4e55-9062-97e47a673dd9): created successfully Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0addcf7a-aaeb-4ae8-b797-15dbb9d2b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:39 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:19:39 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Flow 'volume_create_manager' (cf426e2b-93f7-4f28-bf29-0535f9b6c42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f63c47fe-d394-4c3a-b18c-c3a840cfb0f6 tempest-VolumesExtendTest-435133997 None] Created volume successfully. Nov 05 15:19:39 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:19:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[090cf2b5-c61c-4e00-bcbc-0a61107f6646]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:40 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 Nov 05 15:19:40 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:40 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9" returned: 0 in 0.357s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 2G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 2G" returned: 0 in 0.090s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.472s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9d4f825e-d336-4a7f-88c5-ead9396d2c39 tempest-VolumesExtendTest-435133997 None] Extend volume completed successfully. Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-26be8199-df48-4e55-9062-97e47a673dd9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Lock "cinder-26be8199-df48-4e55-9062-97e47a673dd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-quobyte-26be8199-df48-4e55-9062-97e47a673dd9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-26be8199-df48-4e55-9062-97e47a673dd9" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[711d3984-9d96-4e1a-92cb-27fcf46a9a8f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:41 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 Nov 05 15:19:41 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:41 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9" returned: 0 in 0.351s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:41 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9 Nov 05 15:19:41 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:42 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-26be8199-df48-4e55-9062-97e47a673dd9" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-26be8199-df48-4e55-9062-97e47a673dd9" released by "delete_volume" :: held 0.629s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Created reservations ['28e1dec0-5914-4877-bdb7-eadeecbeef58', '519380c5-d7d4-4f82-bca2-fd34d3647ed4', '11ed3b9e-48de-440e-a83c-463f34bea71f', '1008e796-10d4-491f-9dfc-265c4144e5b7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:42 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:19:42 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:42 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:19:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Deleted volume successfully. Nov 05 15:19:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-3a2b1233-6819-4435-a45c-5cbf617ed50b tempest-VolumesExtendTest-435133997 None] Lock "cinder-26be8199-df48-4e55-9062-97e47a673dd9-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Flow 'volume_create_manager' (9bced58c-27f4-4ead-9198-cd2743cb3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7513369-cfe5-4b15-a17a-c909d052d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7513369-cfe5-4b15-a17a-c909d052d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-53326042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a27f83-6686-41b6-8690-124452085d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012643084347422da91a4e49fcd9d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:43Z,use_quota=True,user_id='6d05239ddfb44b42a4708450c6945916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7069ef4-f5b5-420a-9f35-4838487f383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7069ef4-f5b5-420a-9f35-4838487f383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54671245-50ab-489d-a9d9-400b4630d8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54671245-50ab-489d-a9d9-400b4630d8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a27f83-6686-41b6-8690-124452085d17', 'volume_name': 'volume-84a27f83-6686-41b6-8690-124452085d17', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd3af76-e672-4d06-94ee-a84332b8e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd3af76-e672-4d06-94ee-a84332b8e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbc0195-1404-49b9-8a3a-eb6ca763ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Volume 84a27f83-6686-41b6-8690-124452085d17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a27f83-6686-41b6-8690-124452085d17', 'volume_size': 1} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-53326042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a27f83-6686-41b6-8690-124452085d17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='012643084347422da91a4e49fcd9d055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:43Z,use_quota=True,user_id='6d05239ddfb44b42a4708450c6945916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Creating volume 84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:19:43 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:43 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 1073741824 Nov 05 15:19:43 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:43 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 1073741824" returned: 0 in 0.399s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:43 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 Nov 05 15:19:43 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:43 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbc0195-1404-49b9-8a3a-eb6ca763ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a27f83-6686-41b6-8690-124452085d17', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453cd541-685d-4f49-9a47-46e6582e8e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Volume volume-84a27f83-6686-41b6-8690-124452085d17 (84a27f83-6686-41b6-8690-124452085d17): created successfully Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453cd541-685d-4f49-9a47-46e6582e8e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Flow 'volume_create_manager' (9bced58c-27f4-4ead-9198-cd2743cb3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-171f7182-310b-4aa5-91ea-4de74410afc1 tempest-VolumesExtendTest-435133997 None] Created volume successfully. Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Creating offline snapshot 104b3197-9777-40fe-9564-43a0b1fc1736 of volume 84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f1f977-4391-41cf-80cb-01ba94068d5f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:44 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 Nov 05 15:19:44 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:44 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:44 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 1G Nov 05 15:19:44 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:44 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 1G" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a27f83-6686-41b6-8690-124452085d17 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:44 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a27f83-6686-41b6-8690-124452085d17 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 Nov 05 15:19:44 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:45 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a27f83-6686-41b6-8690-124452085d17 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 is being set with open permissions: ugo+rw Nov 05 15:19:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:45 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 Nov 05 15:19:45 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:45 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:45 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info Nov 05 15:19:45 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:45 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info is being set with open permissions: ugo+rw Nov 05 15:19:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:45 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info Nov 05 15:19:45 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:46 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.info" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e6daff41-4e40-4fe1-8b60-21fde6b989d6 tempest-VolumesExtendTest-435133997 None] Create snapshot completed successfully Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a16fa9-2d4b-46b8-9cf7-84ca63e0ed36]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:46 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 Nov 05 15:19:46 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:46 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17" returned: 0 in 0.361s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 2G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 2G" returned: 0 in 0.125s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.521s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-529f30e8-11fe-4243-a91e-10c23c29ba07 tempest-VolumesExtendTest-435133997 None] Extend volume completed successfully. Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-104b3197-9777-40fe-9564-43a0b1fc1736-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Lock "cinder-104b3197-9777-40fe-9564-43a0b1fc1736-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-quobyte-84a27f83-6686-41b6-8690-124452085d17" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-84a27f83-6686-41b6-8690-124452085d17" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-quobyte-104b3197-9777-40fe-9564-43a0b1fc1736" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-104b3197-9777-40fe-9564-43a0b1fc1736" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Deleting offline snapshot 104b3197-9777-40fe-9564-43a0b1fc1736 of volume 84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] snapshot_file for this snap is: volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad6989-429b-4a2f-9609-c2bb3ffc6849]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:47 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 Nov 05 15:19:47 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:48 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84a27f83-6686-41b6-8690-124452085d17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6c5370-9c62-4487-9449-2ad923cacb4c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:48 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 Nov 05 15:19:48 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:48 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:48 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 Nov 05 15:19:48 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:48 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:48 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736 Nov 05 15:19:48 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:49 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17.104b3197-9777-40fe-9564-43a0b1fc1736" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-104b3197-9777-40fe-9564-43a0b1fc1736" released by "_delete_snapshot" :: held 1.470s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-84a27f83-6686-41b6-8690-124452085d17" released by "delete_snapshot" :: held 1.493s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Created reservations ['163450de-9bd6-428d-90bb-37e70cb1e471', 'ecf3b169-50cd-4f36-bec6-a4d4e2ed747f', '25e1dd77-bf8d-4cb3-b698-7b8f2610fe9e', 'f719c5ee-b6df-49d1-b5fb-2f9de81b2390'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:19:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Delete snapshot completed successfully. Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5f7f54e5-3aa0-4b33-8732-476d71f6aab6 tempest-VolumesExtendTest-435133997 None] Lock "cinder-104b3197-9777-40fe-9564-43a0b1fc1736-delete_snapshot" released by "delete_snapshot" :: held 1.630s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-84a27f83-6686-41b6-8690-124452085d17-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Lock "cinder-84a27f83-6686-41b6-8690-124452085d17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Acquiring lock "cinder-quobyte-84a27f83-6686-41b6-8690-124452085d17" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-84a27f83-6686-41b6-8690-124452085d17" acquired by "delete_volume" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[badcbbbe-dca9-4fd3-8560-38162783e4cc]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:50 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 Nov 05 15:19:50 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:50 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:50 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17 Nov 05 15:19:50 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:50 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-84a27f83-6686-41b6-8690-124452085d17" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Lock "cinder-quobyte-84a27f83-6686-41b6-8690-124452085d17" released by "delete_volume" :: held 0.656s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Created reservations ['1ded950b-3cac-4c49-8363-8b257c831b26', '6f9f2520-6b52-48a4-9207-866afdc9ac10', '0cfde60c-6959-4a20-9e30-a0b500dbc2bf', 'a5ce2662-afc3-44d2-a58c-92f451e1b753'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:50 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:19:50 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:50 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:19:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Deleted volume successfully. Nov 05 15:19:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-beb8a59d-e1a9-4f59-9c96-aa435d64cd9f tempest-VolumesExtendTest-435133997 None] Lock "cinder-84a27f83-6686-41b6-8690-124452085d17-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Flow 'volume_create_manager' (9d4aca01-66a6-47c4-b43e-1dc22e6e2ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e888f99a-7bbb-40b6-af27-508d51d3dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e888f99a-7bbb-40b6-af27-508d51d3dec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-746603350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb637e04-e748-42b2-9ef5-6cd5c0f4a00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5333c245064448899d8bd49e9bfeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:54Z,use_quota=True,user_id='036d78023ff04149b936b7646469894c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441c86bb-67dc-40c2-b3d6-3e4b4f18030c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441c86bb-67dc-40c2-b3d6-3e4b4f18030c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707abcf4-0ffb-4efa-8bbd-d2be7b59e088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707abcf4-0ffb-4efa-8bbd-d2be7b59e088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb637e04-e748-42b2-9ef5-6cd5c0f4a00d', 'volume_name': 'volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f39a3b9-b72f-4930-ba39-687389525777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f39a3b9-b72f-4930-ba39-687389525777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007512b4-2f9f-4ecb-aeb4-b68f5f58d417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Volume bb637e04-e748-42b2-9ef5-6cd5c0f4a00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d', 'volume_size': 1} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-746603350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb637e04-e748-42b2-9ef5-6cd5c0f4a00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5333c245064448899d8bd49e9bfeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:54Z,use_quota=True,user_id='036d78023ff04149b936b7646469894c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Creating volume bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:19:53 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:19:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:53 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d 1073741824 Nov 05 15:19:53 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:54 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d 1073741824" returned: 0 in 0.421s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:54 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d Nov 05 15:19:54 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:54 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007512b4-2f9f-4ecb-aeb4-b68f5f58d417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7416c558-afc1-43a8-8248-de9dc33331be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Volume volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d (bb637e04-e748-42b2-9ef5-6cd5c0f4a00d): created successfully Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7416c558-afc1-43a8-8248-de9dc33331be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Flow 'volume_create_manager' (9d4aca01-66a6-47c4-b43e-1dc22e6e2ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7a2e41a9-f133-4b8a-90f7-337f46859381 tempest-VolumeDependencyTests-2138940816 None] Created volume successfully. Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Creating offline snapshot ed5c36cd-3d1f-4667-aa89-8668963a34be of volume bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f351dc2e-c7a9-4338-b28f-8bd8f13d5046]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:55 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d Nov 05 15:19:55 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:55 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:55 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be 1G Nov 05 15:19:55 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:55 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be 1G" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:55 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be Nov 05 15:19:55 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:56 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:56 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be is being set with open permissions: ugo+rw Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:56 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be Nov 05 15:19:56 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:56 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be" returned: 0 in 0.244s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:56 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info Nov 05 15:19:56 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:56 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:56 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info is being set with open permissions: ugo+rw Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:56 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info Nov 05 15:19:56 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:56 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.info" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3c68ec20-d2ec-4ac2-adf3-bd71c4fbf9f2 tempest-VolumeDependencyTests-2138940816 None] Create snapshot completed successfully Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Flow 'volume_create_manager' (757922f0-a4df-4289-9628-15a9120eaa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34a7d02-0284-4dc3-8d83-6e500b17005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34a7d02-0284-4dc3-8d83-6e500b17005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-469229373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c99b9f-d132-47fb-ba28-1387ecb6fc16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e5333c245064448899d8bd49e9bfeca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed5c36cd-3d1f-4667-aa89-8668963a34be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:19:58Z,use_quota=True,user_id='036d78023ff04149b936b7646469894c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d10254-8bb2-4a7b-9be5-59fef4fb7253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d10254-8bb2-4a7b-9be5-59fef4fb7253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b445e4a8-6002-4749-a01d-30835e0c7892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b445e4a8-6002-4749-a01d-30835e0c7892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '32c99b9f-d132-47fb-ba28-1387ecb6fc16', 'volume_name': 'volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16', 'volume_size': 1, 'snapshot_id': 'ed5c36cd-3d1f-4667-aa89-8668963a34be'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20be25e2-6bfa-4dbd-9f0e-e2b92253b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20be25e2-6bfa-4dbd-9f0e-e2b92253b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd13f46-63e1-4119-b71a-ea22ce0c5104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:19:57 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Volume 32c99b9f-d132-47fb-ba28-1387ecb6fc16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16', 'volume_size': 1, 'snapshot_id': 'ed5c36cd-3d1f-4667-aa89-8668963a34be'} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-quobyte-ed5c36cd-3d1f-4667-aa89-8668963a34be-32c99b9f-d132-47fb-ba28-1387ecb6fc16" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-ed5c36cd-3d1f-4667-aa89-8668963a34be-32c99b9f-d132-47fb-ba28-1387ecb6fc16" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Creating volume 32c99b9f-d132-47fb-ba28-1387ecb6fc16 from snapshot ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-quobyte-32c99b9f-d132-47fb-ba28-1387ecb6fc16" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-32c99b9f-d132-47fb-ba28-1387ecb6fc16" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] snapshot: ed5c36cd-3d1f-4667-aa89-8668963a34be, volume: 32c99b9f-d132-47fb-ba28-1387ecb6fc16, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6ffdc6-1e0e-420f-94cb-6d733f9273bb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:57 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be Nov 05 15:19:57 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:58 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be" returned: 0 in 0.371s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1551ed-7fd1-428e-95e3-f12e0c2d4b24]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:58 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d Nov 05 15:19:58 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:19:58 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:19:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:19:58 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 Nov 05 15:19:58 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:04 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16" returned: 0 in 5.866s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:20:04 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Converted 1024.00 MB image at 174.53 MB/s Nov 05 15:20:04 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 is being set with open permissions: ugo+rw Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:04 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 Nov 05 15:20:04 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:04 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-32c99b9f-d132-47fb-ba28-1387ecb6fc16" released by "_copy_volume_from_snapshot" :: held 6.933s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-ed5c36cd-3d1f-4667-aa89-8668963a34be-32c99b9f-d132-47fb-ba28-1387ecb6fc16" released by "_create_volume_from_snapshot" :: held 6.995s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bd13f46-63e1-4119-b71a-ea22ce0c5104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16', 'volume_size': 1, 'snapshot_id': 'ed5c36cd-3d1f-4667-aa89-8668963a34be'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32012143-e77b-4d00-80a5-b830a45683c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Volume volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 (32c99b9f-d132-47fb-ba28-1387ecb6fc16): created successfully Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32012143-e77b-4d00-80a5-b830a45683c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Flow 'volume_create_manager' (757922f0-a4df-4289-9628-15a9120eaa99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c2d8681f-f283-406b-bb46-c2520d5d05d2 tempest-VolumeDependencyTests-2138940816 None] Created volume successfully. Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-ed5c36cd-3d1f-4667-aa89-8668963a34be-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-ed5c36cd-3d1f-4667-aa89-8668963a34be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-quobyte-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-quobyte-ed5c36cd-3d1f-4667-aa89-8668963a34be" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-ed5c36cd-3d1f-4667-aa89-8668963a34be" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Deleting offline snapshot ed5c36cd-3d1f-4667-aa89-8668963a34be of volume bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] snapshot_file for this snap is: volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[155a45a5-e8ba-4c09-a3bb-cf287a5fe991]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:05 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be Nov 05 15:20:05 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:05 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7010ada7-7dfc-463e-b4f0-cfa2b8a61328]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:05 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d Nov 05 15:20:05 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:06 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" returned: 0 in 0.518s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:06 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be Nov 05 15:20:06 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:06 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:06 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be Nov 05 15:20:06 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:06 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d.ed5c36cd-3d1f-4667-aa89-8668963a34be" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-ed5c36cd-3d1f-4667-aa89-8668963a34be" released by "_delete_snapshot" :: held 1.531s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" released by "delete_snapshot" :: held 1.552s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Created reservations ['330d8ecc-f3db-4fe7-a75a-c521fc5f89bd', '14163860-c095-4c0b-ae34-8b6f7e0d2425', '6b0ad2c8-ad1d-42a1-942f-ef79d159dd68', '2fa66292-20d3-40af-8919-b7c297e64277'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Delete snapshot completed successfully. Nov 05 15:20:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b94394a9-e97c-4f96-aede-0d7b3f1bddaf tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-ed5c36cd-3d1f-4667-aa89-8668963a34be-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-quobyte-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[706af891-e704-4a6b-a901-a01ef6bb580e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:07 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d Nov 05 15:20:07 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:07 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:07 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d Nov 05 15:20:07 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:07 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d" released by "delete_volume" :: held 0.649s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Created reservations ['f75f3dac-c5c8-470f-bfef-2d95bff43507', '64e1e0eb-86b6-4990-b99c-96602efbefb3', '9f1fa648-959a-406c-8102-b2e74a8ea88d', '515f79c1-fbfb-452d-bb63-daeb2f0378e7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:08 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:08 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:08 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Deleted volume successfully. Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33e9308c-431e-4856-8474-54145462a674 tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-bb637e04-e748-42b2-9ef5-6cd5c0f4a00d-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-32c99b9f-d132-47fb-ba28-1387ecb6fc16-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-32c99b9f-d132-47fb-ba28-1387ecb6fc16-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "cinder-quobyte-32c99b9f-d132-47fb-ba28-1387ecb6fc16" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-32c99b9f-d132-47fb-ba28-1387ecb6fc16" acquired by "delete_volume" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb22b9f-53ec-44d7-a2f9-8d364651fbc7]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:08 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 Nov 05 15:20:08 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:08 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:08 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16 Nov 05 15:20:08 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:09 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-32c99b9f-d132-47fb-ba28-1387ecb6fc16" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-quobyte-32c99b9f-d132-47fb-ba28-1387ecb6fc16" released by "delete_volume" :: held 0.632s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Created reservations ['179ed15d-e7bf-4813-a458-0bb495b5cd69', 'bac430db-29bd-498b-b0e6-cd466b597352', 'bd844ef6-dbc6-4389-be35-4ff04b65fd49', '52e07c9b-acba-42ab-aa5d-e8e68206a64d'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:09 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:09 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:09 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Deleted volume successfully. Nov 05 15:20:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9eb16349-990d-4cd6-ab44-aedd4b0db60a tempest-VolumeDependencyTests-2138940816 None] Lock "cinder-32c99b9f-d132-47fb-ba28-1387ecb6fc16-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Flow 'volume_create_manager' (15613ca7-54ae-4e71-827c-f973501fa1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0468c3c8-761d-4287-bb2e-2921d21325e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0468c3c8-761d-4287-bb2e-2921d21325e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197520520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b076e00d-fcd7-47eb-adb7-54bbb1ead128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173e6a9124074696a29ac5adc5696fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:13Z,use_quota=True,user_id='f450832d7b154d1e92fbd32a7d8e734a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315b5cf3-15cc-41f5-9679-5b6e68a88fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (315b5cf3-15cc-41f5-9679-5b6e68a88fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d54ef-f79b-4a6c-96b2-efe4a1479ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d54ef-f79b-4a6c-96b2-efe4a1479ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b076e00d-fcd7-47eb-adb7-54bbb1ead128', 'volume_name': 'volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68cb349-bcbf-47c2-ac16-d4ee2b6b68d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68cb349-bcbf-47c2-ac16-d4ee2b6b68d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d291d5-e577-4c42-80f1-be83acc064c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Volume b076e00d-fcd7-47eb-adb7-54bbb1ead128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128', 'volume_size': 1} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-197520520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b076e00d-fcd7-47eb-adb7-54bbb1ead128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173e6a9124074696a29ac5adc5696fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:13Z,use_quota=True,user_id='f450832d7b154d1e92fbd32a7d8e734a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Creating volume b076e00d-fcd7-47eb-adb7-54bbb1ead128 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:20:12 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:20:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:12 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 1073741824 Nov 05 15:20:12 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:13 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 1073741824" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:13 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 Nov 05 15:20:13 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:13 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128" returned: 0 in 0.235s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d291d5-e577-4c42-80f1-be83acc064c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb319fe6-b3ac-44ab-ab4f-8d0562ee1c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Volume volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 (b076e00d-fcd7-47eb-adb7-54bbb1ead128): created successfully Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb319fe6-b3ac-44ab-ab4f-8d0562ee1c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Flow 'volume_create_manager' (15613ca7-54ae-4e71-827c-f973501fa1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e9e3641a-da5c-4a40-88ef-1e202363f90b tempest-ProjectReaderTests-1292327589 None] Created volume successfully. Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Acquiring lock "cinder-b076e00d-fcd7-47eb-adb7-54bbb1ead128-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-b076e00d-fcd7-47eb-adb7-54bbb1ead128-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Acquiring lock "cinder-quobyte-b076e00d-fcd7-47eb-adb7-54bbb1ead128" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-quobyte-b076e00d-fcd7-47eb-adb7-54bbb1ead128" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a71c71-fc12-4fe0-8285-e4008d3fac54]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:14 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 Nov 05 15:20:14 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:14 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:14 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128 Nov 05 15:20:14 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:14 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b076e00d-fcd7-47eb-adb7-54bbb1ead128" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-quobyte-b076e00d-fcd7-47eb-adb7-54bbb1ead128" released by "delete_volume" :: held 0.653s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Created reservations ['390d1ad0-3ddd-4ad6-af4e-716c76084250', 'ef970944-e376-47c4-9bf6-ab7d8da95e9f', '283d9d55-21eb-4714-8310-8ea7df7cdca0', '5a9e2f00-c68b-429b-97d1-81645e90948c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:14 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:14 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:15 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Deleted volume successfully. Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a8036252-f321-410e-bf18-9d9b803cc7f0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-b076e00d-fcd7-47eb-adb7-54bbb1ead128-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Flow 'volume_create_manager' (968ddcd9-5206-421f-a830-6ae1e09b650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ca8174-9c68-4cef-9f7c-7a178b1d7a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6ca8174-9c68-4cef-9f7c-7a178b1d7a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253164257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fb4ea4-fdad-4156-8635-4d5dec8b9031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173e6a9124074696a29ac5adc5696fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:16Z,use_quota=True,user_id='f450832d7b154d1e92fbd32a7d8e734a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680daa22-b2e1-41c1-8998-8e312cebf634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680daa22-b2e1-41c1-8998-8e312cebf634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664e45b6-216f-491c-b23d-a10cb15ed4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664e45b6-216f-491c-b23d-a10cb15ed4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fb4ea4-fdad-4156-8635-4d5dec8b9031', 'volume_name': 'volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcba35f7-2433-46af-b9b5-bbb745c738e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcba35f7-2433-46af-b9b5-bbb745c738e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592dd1d9-2196-47a7-9722-e22771816af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Volume 85fb4ea4-fdad-4156-8635-4d5dec8b9031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031', 'volume_size': 1} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1253164257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fb4ea4-fdad-4156-8635-4d5dec8b9031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173e6a9124074696a29ac5adc5696fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:16Z,use_quota=True,user_id='f450832d7b154d1e92fbd32a7d8e734a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Creating volume 85fb4ea4-fdad-4156-8635-4d5dec8b9031 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:20:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:20:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:15 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 1073741824 Nov 05 15:20:15 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:16 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 1073741824" returned: 0 in 0.418s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:16 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 Nov 05 15:20:16 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:16 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592dd1d9-2196-47a7-9722-e22771816af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d01ed1-3f7d-42b5-90af-2efec3f2a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Volume volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 (85fb4ea4-fdad-4156-8635-4d5dec8b9031): created successfully Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d01ed1-3f7d-42b5-90af-2efec3f2a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Flow 'volume_create_manager' (968ddcd9-5206-421f-a830-6ae1e09b650d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8dd832b4-86f0-4b08-bb02-9b827af65ead tempest-ProjectReaderTests-1292327589 None] Created volume successfully. Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Acquiring lock "cinder-85fb4ea4-fdad-4156-8635-4d5dec8b9031-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-85fb4ea4-fdad-4156-8635-4d5dec8b9031-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Acquiring lock "cinder-quobyte-85fb4ea4-fdad-4156-8635-4d5dec8b9031" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-quobyte-85fb4ea4-fdad-4156-8635-4d5dec8b9031" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[19adc755-7235-4e57-92f0-1dceabeb32cb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:16 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 Nov 05 15:20:16 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:17 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:17 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031 Nov 05 15:20:17 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:17 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85fb4ea4-fdad-4156-8635-4d5dec8b9031" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-quobyte-85fb4ea4-fdad-4156-8635-4d5dec8b9031" released by "delete_volume" :: held 0.636s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Created reservations ['a24615dc-7f19-45c8-a45a-5573288fbd7f', '974a0939-d5b4-4261-b8bc-65c76a7e81f4', 'a2ede052-a936-4d48-82c4-d2717a24ec58', 'e712ba7d-cab2-4211-a0b5-808b79cc7464'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:17 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:17 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:17 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Deleted volume successfully. Nov 05 15:20:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-149b7d0b-e116-4119-9223-14406288afc0 tempest-ProjectReaderTests-1292327589 None] Lock "cinder-85fb4ea4-fdad-4156-8635-4d5dec8b9031-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=70,cinder:UPDATE=91,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:20:29 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=75,cinder:UPDATE=83,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:39 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:39 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:39 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:20:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Flow 'volume_create_manager' (500c34e8-baff-4df1-819f-1fc1c0fa951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16e29aa-fc45-4edb-a204-aa63dd47534b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16e29aa-fc45-4edb-a204-aa63dd47534b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1811942246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51469223-2679-41c8-bbe8-ef3cf9e3382c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f0c589680a4e4ea07758a855dab923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:40Z,use_quota=True,user_id='237cce671ec74ef496eb6d4708c6e390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7da62fc-5d86-4ade-b5e3-25e9f3a6b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7da62fc-5d86-4ade-b5e3-25e9f3a6b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b27783a-6746-4037-b4ab-9c0578fad59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b27783a-6746-4037-b4ab-9c0578fad59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51469223-2679-41c8-bbe8-ef3cf9e3382c', 'volume_name': 'volume-51469223-2679-41c8-bbe8-ef3cf9e3382c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dc3a28-f2b7-426e-8259-ac10fc7889c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34dc3a28-f2b7-426e-8259-ac10fc7889c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4439438-7876-4ba7-b493-91d5faa9163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Volume 51469223-2679-41c8-bbe8-ef3cf9e3382c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51469223-2679-41c8-bbe8-ef3cf9e3382c', 'volume_size': 1} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1811942246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51469223-2679-41c8-bbe8-ef3cf9e3382c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f0c589680a4e4ea07758a855dab923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:40Z,use_quota=True,user_id='237cce671ec74ef496eb6d4708c6e390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Creating volume 51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:20:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:40 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c 1073741824 Nov 05 15:20:40 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:40 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c 1073741824" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:40 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c Nov 05 15:20:40 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:40 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4439438-7876-4ba7-b493-91d5faa9163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51469223-2679-41c8-bbe8-ef3cf9e3382c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7060490b-4a38-440f-821e-52f552783f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Volume volume-51469223-2679-41c8-bbe8-ef3cf9e3382c (51469223-2679-41c8-bbe8-ef3cf9e3382c): created successfully Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7060490b-4a38-440f-821e-52f552783f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Flow 'volume_create_manager' (500c34e8-baff-4df1-819f-1fc1c0fa951a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a50f739f-36c6-453c-864f-ad5bc2035553 tempest-SnapshotDependencyTests-649561911 None] Created volume successfully. Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Creating offline snapshot 9faf0a4f-6e24-401e-9053-81bfd8222944 of volume 51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4544a435-ab11-42c6-80ca-6b571e833548]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:41 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c Nov 05 15:20:41 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:41 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:41 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 1G Nov 05 15:20:41 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:41 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 1G" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51469223-2679-41c8-bbe8-ef3cf9e3382c -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:41 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51469223-2679-41c8-bbe8-ef3cf9e3382c -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 Nov 05 15:20:41 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:42 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51469223-2679-41c8-bbe8-ef3cf9e3382c -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944" returned: 0 in 0.295s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:42 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 is being set with open permissions: ugo+rw Nov 05 15:20:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:42 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 Nov 05 15:20:42 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:42 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944" returned: 0 in 0.234s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:42 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info Nov 05 15:20:42 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:42 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:42 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info is being set with open permissions: ugo+rw Nov 05 15:20:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:42 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info Nov 05 15:20:42 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:43 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.info" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ed5dbb4a-a3ff-4503-8532-54dd2b98c1d7 tempest-SnapshotDependencyTests-649561911 None] Create snapshot completed successfully Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Flow 'volume_create_manager' (0d747ddb-b433-4615-a0d8-496e8a6a581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aadc959-981d-481f-8e20-d99fe757b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aadc959-981d-481f-8e20-d99fe757b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db670cad-50ac-4a40-a36f-2418c36e5b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f0c589680a4e4ea07758a855dab923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9faf0a4f-6e24-401e-9053-81bfd8222944,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:20:44Z,use_quota=True,user_id='237cce671ec74ef496eb6d4708c6e390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150ab741-aad0-420d-9859-2cb697d538df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150ab741-aad0-420d-9859-2cb697d538df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe22dd5-6179-41ea-b0d8-3738c492f71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe22dd5-6179-41ea-b0d8-3738c492f71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db670cad-50ac-4a40-a36f-2418c36e5b51', 'volume_name': 'volume-db670cad-50ac-4a40-a36f-2418c36e5b51', 'volume_size': 1, 'snapshot_id': '9faf0a4f-6e24-401e-9053-81bfd8222944'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b915b2e7-e255-4a2d-977a-51fece889eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b915b2e7-e255-4a2d-977a-51fece889eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49861360-4a22-4c8f-817a-0d20dc3eea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:43 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Volume db670cad-50ac-4a40-a36f-2418c36e5b51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db670cad-50ac-4a40-a36f-2418c36e5b51', 'volume_size': 1, 'snapshot_id': '9faf0a4f-6e24-401e-9053-81bfd8222944'} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-quobyte-9faf0a4f-6e24-401e-9053-81bfd8222944-db670cad-50ac-4a40-a36f-2418c36e5b51" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-9faf0a4f-6e24-401e-9053-81bfd8222944-db670cad-50ac-4a40-a36f-2418c36e5b51" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Creating volume db670cad-50ac-4a40-a36f-2418c36e5b51 from snapshot 9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-quobyte-db670cad-50ac-4a40-a36f-2418c36e5b51" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-db670cad-50ac-4a40-a36f-2418c36e5b51" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] snapshot: 9faf0a4f-6e24-401e-9053-81bfd8222944, volume: db670cad-50ac-4a40-a36f-2418c36e5b51, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd847e6d-413e-412e-b061-9eaef84c9269]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:44 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 Nov 05 15:20:44 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:44 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944" returned: 0 in 0.362s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51469223-2679-41c8-bbe8-ef3cf9e3382c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f940a-9824-4089-b49e-d930d47470d1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:44 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c Nov 05 15:20:44 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:44 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c" returned: 0 in 0.346s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:20:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:44 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 Nov 05 15:20:44 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:50 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51" returned: 0 in 5.854s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:20:50 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Converted 1024.00 MB image at 174.87 MB/s Nov 05 15:20:50 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 is being set with open permissions: ugo+rw Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:50 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 Nov 05 15:20:50 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:50 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-db670cad-50ac-4a40-a36f-2418c36e5b51" released by "_copy_volume_from_snapshot" :: held 6.879s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-9faf0a4f-6e24-401e-9053-81bfd8222944-db670cad-50ac-4a40-a36f-2418c36e5b51" released by "_create_volume_from_snapshot" :: held 6.937s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.952s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49861360-4a22-4c8f-817a-0d20dc3eea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db670cad-50ac-4a40-a36f-2418c36e5b51', 'volume_size': 1, 'snapshot_id': '9faf0a4f-6e24-401e-9053-81bfd8222944'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f8eb8b-6109-4921-8b44-9def631aa47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:20:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Volume volume-db670cad-50ac-4a40-a36f-2418c36e5b51 (db670cad-50ac-4a40-a36f-2418c36e5b51): created successfully Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f8eb8b-6109-4921-8b44-9def631aa47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:20:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Flow 'volume_create_manager' (0d747ddb-b433-4615-a0d8-496e8a6a581b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:20:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4a318bc1-d960-4547-8281-53e7def1c4ef tempest-SnapshotDependencyTests-649561911 None] Created volume successfully. Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-9faf0a4f-6e24-401e-9053-81bfd8222944-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-9faf0a4f-6e24-401e-9053-81bfd8222944-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-quobyte-51469223-2679-41c8-bbe8-ef3cf9e3382c" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-51469223-2679-41c8-bbe8-ef3cf9e3382c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-quobyte-9faf0a4f-6e24-401e-9053-81bfd8222944" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-9faf0a4f-6e24-401e-9053-81bfd8222944" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Deleting offline snapshot 9faf0a4f-6e24-401e-9053-81bfd8222944 of volume 51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] snapshot_file for this snap is: volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46669cb-c1bf-4d48-9fa5-ff8ba2a9c1c9]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:51 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 Nov 05 15:20:51 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:51 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944" returned: 0 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51469223-2679-41c8-bbe8-ef3cf9e3382c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b375a2b9-ce75-4866-b5dd-d22056d31ec1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:51 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c Nov 05 15:20:51 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:52 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c" returned: 0 in 0.526s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:52 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 Nov 05 15:20:52 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:52 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944" returned: 0 in 0.317s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:52 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944 Nov 05 15:20:52 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:52 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c.9faf0a4f-6e24-401e-9053-81bfd8222944" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-9faf0a4f-6e24-401e-9053-81bfd8222944" released by "_delete_snapshot" :: held 1.532s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-51469223-2679-41c8-bbe8-ef3cf9e3382c" released by "delete_snapshot" :: held 1.551s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Created reservations ['8cd24d80-80fb-4480-a330-c94f7ab8d6ba', '23b547b2-71cc-4366-9476-57a6ac48f74c', '70ba244e-64bc-4ea2-9670-dddfa899f25d', '0dd95a9a-a1a0-463b-b37a-1c220a0de7c0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Delete snapshot completed successfully. Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7b394361-655d-4bd8-ae50-05f6560bd920 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-9faf0a4f-6e24-401e-9053-81bfd8222944-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-51469223-2679-41c8-bbe8-ef3cf9e3382c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-51469223-2679-41c8-bbe8-ef3cf9e3382c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-quobyte-51469223-2679-41c8-bbe8-ef3cf9e3382c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-51469223-2679-41c8-bbe8-ef3cf9e3382c" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eed8072-9176-4634-9107-7a8bf3b65b37]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:53 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c Nov 05 15:20:53 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:54 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:54 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c Nov 05 15:20:54 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:54 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-51469223-2679-41c8-bbe8-ef3cf9e3382c" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-51469223-2679-41c8-bbe8-ef3cf9e3382c" released by "delete_volume" :: held 0.649s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Created reservations ['19e9751a-7032-4f7e-b88e-d7dd2d4cebd3', '33936693-8cf5-4e61-959b-480ef837a413', '043b7d13-c384-45fb-a25d-48df15d38adf', 'c9db7db0-c1b0-494c-8586-052e18542508'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:54 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:54 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:54 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.236s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Deleted volume successfully. Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dae78fd4-c9d8-402a-a674-fba5fba5853c tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-51469223-2679-41c8-bbe8-ef3cf9e3382c-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-db670cad-50ac-4a40-a36f-2418c36e5b51-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-db670cad-50ac-4a40-a36f-2418c36e5b51-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "cinder-quobyte-db670cad-50ac-4a40-a36f-2418c36e5b51" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-db670cad-50ac-4a40-a36f-2418c36e5b51" acquired by "delete_volume" :: waited 0.012s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e914d99-8b97-4147-8c81-395423137c1f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:20:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:54 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 Nov 05 15:20:54 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:55 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:55 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51 Nov 05 15:20:55 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:55 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-db670cad-50ac-4a40-a36f-2418c36e5b51" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-quobyte-db670cad-50ac-4a40-a36f-2418c36e5b51" released by "delete_volume" :: held 0.637s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Created reservations ['05394607-c4b5-4c1e-bc9a-e19cd8cef6be', 'c838ae36-4861-4721-903c-44efacfeabde', 'cb755818-7a04-4d6b-96c0-198eedf72ddc', '4b068305-e295-4357-975b-33f0d9499bfa'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:20:55 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:20:55 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:20:55 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:20:55 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Deleted volume successfully. Nov 05 15:20:55 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1f427aec-5c31-43f7-8085-3fdcc5298e94 tempest-SnapshotDependencyTests-649561911 None] Lock "cinder-db670cad-50ac-4a40-a36f-2418c36e5b51-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:05 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:21:05 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (414b9ecc-df7a-4f79-ae7e-9fd933d2cf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e78fb0-3d77-44f6-858d-c95a1c4e4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e78fb0-3d77-44f6-858d-c95a1c4e4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602932861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbcd55d-dd52-4544-9e8b-fc66dd54df9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:15Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6b3734-27b7-4720-9f82-8ccdcc23f0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6b3734-27b7-4720-9f82-8ccdcc23f0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7f4e1e-fb0e-473e-b2ef-b1d180d4d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7f4e1e-fb0e-473e-b2ef-b1d180d4d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbcd55d-dd52-4544-9e8b-fc66dd54df9f', 'volume_name': 'volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f859d46f-7e12-4a5f-bf77-dcbc91f328c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f859d46f-7e12-4a5f-bf77-dcbc91f328c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620e10a1-f3e2-4ffb-aec5-bca13988a625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume 6fbcd55d-dd52-4544-9e8b-fc66dd54df9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f', 'volume_size': 1} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602932861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbcd55d-dd52-4544-9e8b-fc66dd54df9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:15Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating volume 6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:15 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f 1073741824 Nov 05 15:21:15 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (6e36aba2-6fd5-46d9-a2fe-8b2eeb1b80b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:16 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f8cf3f-2d78-4111-ba01-0ae0d1d85340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f 1073741824" returned: 0 in 0.613s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f8cf3f-2d78-4111-ba01-0ae0d1d85340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912457636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40453a3-99e3-478f-8973-7e5af532bc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:16Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb934104-6002-461c-b0e0-a39bff399b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb934104-6002-461c-b0e0-a39bff399b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b51d4b6-9ffc-46b8-91a8-9a3684c8bacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b51d4b6-9ffc-46b8-91a8-9a3684c8bacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40453a3-99e3-478f-8973-7e5af532bc6d', 'volume_name': 'volume-b40453a3-99e3-478f-8973-7e5af532bc6d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c941018-378d-43d4-a00b-a43c28279f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c941018-378d-43d4-a00b-a43c28279f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3238384-8e8d-4128-bcaa-c31b2f5dfb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Volume b40453a3-99e3-478f-8973-7e5af532bc6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40453a3-99e3-478f-8973-7e5af532bc6d', 'volume_size': 1} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Flow 'volume_create_manager' (eb52896f-3d17-4e9a-bf0e-d019ebdea754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a9db23-41dd-4fb6-8a21-5517d80b3bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a9db23-41dd-4fb6-8a21-5517d80b3bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03346c3c-3888-4ef7-8868-df6dd8e3a592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962b295b6fd44452abb55ea9f0e038f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:16Z,use_quota=True,user_id='e2c52c8d7f5040ee8dc9e14d2a8384d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171aefe3-7c18-4061-aa08-f901a0cf4061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171aefe3-7c18-4061-aa08-f901a0cf4061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5ffa63-b794-4ce3-80b7-db5ab5ea0578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5ffa63-b794-4ce3-80b7-db5ab5ea0578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03346c3c-3888-4ef7-8868-df6dd8e3a592', 'volume_name': 'volume-03346c3c-3888-4ef7-8868-df6dd8e3a592', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8151a23d-f9d1-4b5f-a6d7-202e0015bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8151a23d-f9d1-4b5f-a6d7-202e0015bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc3e1ca-ccc2-4205-a295-645f7cab8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Volume 03346c3c-3888-4ef7-8868-df6dd8e3a592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03346c3c-3888-4ef7-8868-df6dd8e3a592', 'volume_size': 1} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:16 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f Nov 05 15:21:16 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (a9799314-9d20-4e84-89e9-bdef2186809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a65d32-692d-4c85-ac58-bc99412533ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a65d32-692d-4c85-ac58-bc99412533ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977285790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635f04e5-8fc4-4dca-9f2a-910962cc8738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:16Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1052a-f1c3-4c6e-9a3d-f7aef0877b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1052a-f1c3-4c6e-9a3d-f7aef0877b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb499f2-58d6-4879-9267-5de65685adca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb499f2-58d6-4879-9267-5de65685adca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635f04e5-8fc4-4dca-9f2a-910962cc8738', 'volume_name': 'volume-635f04e5-8fc4-4dca-9f2a-910962cc8738', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6196c321-50fa-498d-822b-c156d9ecf73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6196c321-50fa-498d-822b-c156d9ecf73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d94160-46be-40fe-a289-017d1fa785d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Volume 635f04e5-8fc4-4dca-9f2a-910962cc8738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635f04e5-8fc4-4dca-9f2a-910962cc8738', 'volume_size': 1} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:16 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" returned: 0 in 0.323s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.501s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1912457636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40453a3-99e3-478f-8973-7e5af532bc6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:16Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Creating volume b40453a3-99e3-478f-8973-7e5af532bc6d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620e10a1-f3e2-4ffb-aec5-bca13988a625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d 1073741824 Nov 05 15:21:16 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9b28f0-42fc-4172-af7c-b0c5d28c420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f (6fbcd55d-dd52-4544-9e8b-fc66dd54df9f): created successfully Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9b28f0-42fc-4172-af7c-b0c5d28c420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (414b9ecc-df7a-4f79-ae7e-9fd933d2cf9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-836bc7f1-0deb-4621-8698-a933e54c99f3 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created volume successfully. Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (47d61f8e-5f10-4d58-a5c7-59cd9b96c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ecc6c46-101a-4449-8489-9b77c087a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ecc6c46-101a-4449-8489-9b77c087a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458213844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d05854-5285-45c1-8727-58ffba412ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:17Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e542ba24-de7a-4bcd-8bbf-03b8a2ac4901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e542ba24-de7a-4bcd-8bbf-03b8a2ac4901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03782235-34cd-492b-9f71-84143f17f0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03782235-34cd-492b-9f71-84143f17f0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d05854-5285-45c1-8727-58ffba412ed1', 'volume_name': 'volume-21d05854-5285-45c1-8727-58ffba412ed1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed34ca8f-c9a4-4f29-b13a-cc8c555560bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed34ca8f-c9a4-4f29-b13a-cc8c555560bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2926b6b9-59d6-49e2-8d81-66c64b28b733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Volume 21d05854-5285-45c1-8727-58ffba412ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d05854-5285-45c1-8727-58ffba412ed1', 'volume_size': 1} Nov 05 15:21:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:17 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (6c9b3211-021b-4020-8fb5-ca06a2ebe4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3740a3-d3d7-4ad2-89f4-a6372e3ad977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d 1073741824" returned: 0 in 0.704s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3740a3-d3d7-4ad2-89f4-a6372e3ad977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513443843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3f6164-dadc-411c-ac1b-13031ba1458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:17Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb0d12-606b-4cf5-8fe5-f129494e2db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb0d12-606b-4cf5-8fe5-f129494e2db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c590f0e8-7812-4152-a4bb-84e94c6ce6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c590f0e8-7812-4152-a4bb-84e94c6ce6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3f6164-dadc-411c-ac1b-13031ba1458d', 'volume_name': 'volume-fc3f6164-dadc-411c-ac1b-13031ba1458d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df02a8a6-e3c1-47d1-9c81-aa3215ab71b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df02a8a6-e3c1-47d1-9c81-aa3215ab71b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5da8a7-532e-4a2e-87b7-50aacd3e84ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Volume fc3f6164-dadc-411c-ac1b-13031ba1458d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3f6164-dadc-411c-ac1b-13031ba1458d', 'volume_size': 1} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:17 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d Nov 05 15:21:17 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (946e36aa-8192-4c00-86c8-10ac11690d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7f7a57-96d5-411b-9bd9-2c93294c6e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03346c3c-3888-4ef7-8868-df6dd8e3a592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962b295b6fd44452abb55ea9f0e038f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:16Z,use_quota=True,user_id='e2c52c8d7f5040ee8dc9e14d2a8384d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Creating volume 03346c3c-3888-4ef7-8868-df6dd8e3a592 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7f7a57-96d5-411b-9bd9-2c93294c6e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013315084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85057f1-b569-460c-9275-3081847b64ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:18Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40950d10-f8e4-4be5-a3cb-7b79e66ee10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40950d10-f8e4-4be5-a3cb-7b79e66ee10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 1073741824 Nov 05 15:21:17 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafbb9c0-2a43-4999-887c-f2aa2270e51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafbb9c0-2a43-4999-887c-f2aa2270e51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f85057f1-b569-460c-9275-3081847b64ee', 'volume_name': 'volume-f85057f1-b569-460c-9275-3081847b64ee', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31337e6b-86b4-4b37-a52b-fe1de140f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31337e6b-86b4-4b37-a52b-fe1de140f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b2cdd5-8b4d-4802-b6a6-5bfa68720cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Volume f85057f1-b569-460c-9275-3081847b64ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f85057f1-b569-460c-9275-3081847b64ee', 'volume_size': 1} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3238384-8e8d-4128-bcaa-c31b2f5dfb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40453a3-99e3-478f-8973-7e5af532bc6d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111cbab6-606c-44a0-a6d0-d4225348ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Volume volume-b40453a3-99e3-478f-8973-7e5af532bc6d (b40453a3-99e3-478f-8973-7e5af532bc6d): created successfully Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111cbab6-606c-44a0-a6d0-d4225348ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (6e36aba2-6fd5-46d9-a2fe-8b2eeb1b80b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e24911ed-70a9-4cee-a642-f2c859acaf5f tempest-CreateVolumesFromImageTest-1972530542 None] Created volume successfully. Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:18 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 1073741824" returned: 0 in 0.508s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:18 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 Nov 05 15:21:18 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:18 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977285790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635f04e5-8fc4-4dca-9f2a-910962cc8738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:16Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Creating volume 635f04e5-8fc4-4dca-9f2a-910962cc8738 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:18 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cc3e1ca-ccc2-4205-a295-645f7cab8e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03346c3c-3888-4ef7-8868-df6dd8e3a592', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dd8519-bbb0-418a-8f6e-c3915aa0d397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:18 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 1073741824 Nov 05 15:21:18 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:18 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Volume volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 (03346c3c-3888-4ef7-8868-df6dd8e3a592): created successfully Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4dd8519-bbb0-418a-8f6e-c3915aa0d397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Flow 'volume_create_manager' (eb52896f-3d17-4e9a-bf0e-d019ebdea754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b6e74b76-75b6-4984-bb9d-6cf42e61f26f tempest-CinderUnicodeTest-590043516 None] Created volume successfully. Nov 05 15:21:18 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 1073741824" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:19 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 Nov 05 15:21:19 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:19 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738" returned: 0 in 0.306s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.464s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458213844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d05854-5285-45c1-8727-58ffba412ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:17Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Creating volume 21d05854-5285-45c1-8727-58ffba412ed1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:19 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35d94160-46be-40fe-a289-017d1fa785d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635f04e5-8fc4-4dca-9f2a-910962cc8738', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff29722d-8184-4d7b-a2ff-4a53720875a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 1073741824 Nov 05 15:21:19 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Volume volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 (635f04e5-8fc4-4dca-9f2a-910962cc8738): created successfully Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff29722d-8184-4d7b-a2ff-4a53720875a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (a9799314-9d20-4e84-89e9-bdef2186809a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-176c4eb9-381d-4600-a32e-98b2085985ce tempest-CreateVolumesFromImageTest-1972530542 None] Created volume successfully. Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Flow 'volume_create_manager' (baca5503-f330-49e1-8dd6-c1b85f576e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5846d7a2-73cd-4765-9203-ec96e3070488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5846d7a2-73cd-4765-9203-ec96e3070488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f252bae2-685b-4592-86ec-9ccecd74c5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a999a43c92a74ba2838320c8d1318efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:19Z,use_quota=True,user_id='0cc6f65b87b249c5a02fd4eb36c23c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050179e-bfde-4181-990f-6eb29be2cc4e),volume_type_id=f050179e-bfde-4181-990f-6eb29be2cc4e)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f51e8-da35-4483-9baf-dac14982f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17f51e8-da35-4483-9baf-dac14982f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddda059-1859-4735-85ac-3ce0dc0f1f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Flow 'volume_create_manager' (17cdf8c9-8790-424f-aa0b-186e578b0ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44624b19-7e50-4a6e-8345-0edade921666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44624b19-7e50-4a6e-8345-0edade921666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-225375809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22092311-bcdc-427b-9217-0214ffbbd0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962b295b6fd44452abb55ea9f0e038f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:20Z,use_quota=True,user_id='e2c52c8d7f5040ee8dc9e14d2a8384d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1208268-9a25-43ce-977d-31233afe2bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1208268-9a25-43ce-977d-31233afe2bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25cf76a-ff68-4720-a911-2b921f11c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25cf76a-ff68-4720-a911-2b921f11c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22092311-bcdc-427b-9217-0214ffbbd0cd', 'volume_name': 'volume-22092311-bcdc-427b-9217-0214ffbbd0cd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5248700e-7a83-42a5-8d22-dd3acec590f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5248700e-7a83-42a5-8d22-dd3acec590f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42f031c-97fc-4219-a09c-bdad2a04cd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Volume 22092311-bcdc-427b-9217-0214ffbbd0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22092311-bcdc-427b-9217-0214ffbbd0cd', 'volume_size': 1} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:19 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 1073741824" returned: 0 in 0.536s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ddda059-1859-4735-85ac-3ce0dc0f1f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f252bae2-685b-4592-86ec-9ccecd74c5f6', 'volume_name': 'volume-f252bae2-685b-4592-86ec-9ccecd74c5f6', 'volume_size': 1, 'image_id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28a6345949b9e2099a3006f7eca94884', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a999a43c92a74ba2838320c8d1318efb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2842f543ca8b4c0a9ebd465aff47b2f533d199a60f06cbc850cea91ffd05b548e8c83e44c2a41f05a4e74066d821313fe326f8d797484ae83f3f2435835c165', 'id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'created_at': datetime.datetime(2026, 11, 5, 14, 21, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 21, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4d8f5c-744c-4fd8-bc82-5611e7707852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4d8f5c-744c-4fd8-bc82-5611e7707852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a549c64-85ad-481b-8c3d-5604c1ba9eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:19 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Volume f252bae2-685b-4592-86ec-9ccecd74c5f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f252bae2-685b-4592-86ec-9ccecd74c5f6', 'volume_size': 1, 'image_id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28a6345949b9e2099a3006f7eca94884', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a999a43c92a74ba2838320c8d1318efb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2842f543ca8b4c0a9ebd465aff47b2f533d199a60f06cbc850cea91ffd05b548e8c83e44c2a41f05a4e74066d821313fe326f8d797484ae83f3f2435835c165', 'id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'created_at': datetime.datetime(2026, 11, 5, 14, 21, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 21, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Trying to clone f252bae2-685b-4592-86ec-9ccecd74c5f6 from image 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:21:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:19 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 Nov 05 15:21:19 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:21:20 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Image download 0.00 MB at 0.00 MB/s Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[98208f2a-b879-4440-b30f-ad90fb95d9b5]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:20 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD Nov 05 15:21:20 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:20 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1513443843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3f6164-dadc-411c-ac1b-13031ba1458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:17Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Creating volume fc3f6164-dadc-411c-ac1b-13031ba1458d {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2926b6b9-59d6-49e2-8d81-66c64b28b733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d05854-5285-45c1-8727-58ffba412ed1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1585b5-7c44-4014-99c2-88e13346172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:20 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d 1073741824 Nov 05 15:21:20 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Volume volume-21d05854-5285-45c1-8727-58ffba412ed1 (21d05854-5285-45c1-8727-58ffba412ed1): created successfully Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1585b5-7c44-4014-99c2-88e13346172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (47d61f8e-5f10-4d58-a5c7-59cd9b96c044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-13d90dcb-51fa-4dd9-9dc8-fcd961477c4b tempest-CreateVolumesFromImageTest-1972530542 None] Created volume successfully. Nov 05 15:21:20 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:20 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD Nov 05 15:21:20 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:20 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d 1073741824" returned: 0 in 0.459s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:20 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d Nov 05 15:21:20 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:20 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Temporary image 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb is fetched for user 0cc6f65b87b249c5a02fd4eb36c23c19. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1178c4-27ae-459b-9193-b2fabd08694b]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:20 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD Nov 05 15:21:20 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:20 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1013315084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f85057f1-b569-460c-9275-3081847b64ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b283bd47b7074a03be249dc767b8268c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:18Z,use_quota=True,user_id='93507b7e191d4af4aec8724479395c67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Creating volume f85057f1-b569-460c-9275-3081847b64ee {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5da8a7-532e-4a2e-87b7-50aacd3e84ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3f6164-dadc-411c-ac1b-13031ba1458d', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15460ace-74b9-43a4-9b06-7f1a2ea9b46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:21 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee 1073741824 Nov 05 15:21:21 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Volume volume-fc3f6164-dadc-411c-ac1b-13031ba1458d (fc3f6164-dadc-411c-ac1b-13031ba1458d): created successfully Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15460ace-74b9-43a4-9b06-7f1a2ea9b46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (6c9b3211-021b-4020-8fb5-ca06a2ebe4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dab72bcd-7b28-478c-954a-9c8fca03b9ec tempest-CreateVolumesFromImageTest-1972530542 None] Created volume successfully. Nov 05 15:21:21 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:21 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD Nov 05 15:21:21 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:21 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee 1073741824" returned: 0 in 0.484s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:21 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:21 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee Nov 05 15:21:21 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:21 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee" returned: 0 in 0.249s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.709s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42b2cdd5-8b4d-4802-b6a6-5bfa68720cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f85057f1-b569-460c-9275-3081847b64ee', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c03c4a-b43d-4342-863d-352878412608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating offline snapshot 15492af3-73dc-45b8-8096-9190a9defc81 of volume 6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:21:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Volume volume-f85057f1-b569-460c-9275-3081847b64ee (f85057f1-b569-460c-9275-3081847b64ee): created successfully Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c03c4a-b43d-4342-863d-352878412608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Flow 'volume_create_manager' (946e36aa-8192-4c00-86c8-10ac11690d89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a738d9d-0175-4d17-a870-2212a57ae00c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7683ac76-be66-4e97-9353-936c0c37ba51 tempest-CreateVolumesFromImageTest-1972530542 None] Created volume successfully. Nov 05 15:21:21 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f Nov 05 15:21:21 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-f85057f1-b569-460c-9275-3081847b64ee-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-f85057f1-b569-460c-9275-3081847b64ee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-quobyte-f85057f1-b569-460c-9275-3081847b64ee" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-f85057f1-b569-460c-9275-3081847b64ee" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f12ad6-7959-4d0e-858c-a6649be48888]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:22 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:22 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 1G Nov 05 15:21:22 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:22 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee Nov 05 15:21:22 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:22 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:22 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee Nov 05 15:21:22 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:22 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 1G" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:22 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 Nov 05 15:21:22 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:22 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f85057f1-b569-460c-9275-3081847b64ee" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-f85057f1-b569-460c-9275-3081847b64ee" released by "delete_volume" :: held 0.698s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Created reservations ['84d33210-4e9c-4028-8603-472d583d9dbd', '0349cfee-abe2-4fd1-a9d0-34e5bf69d390', 'b82799c8-dfe2-4681-a05d-53b7493c8f18', '2386b105-91b5-4851-891a-4cb977e4123a'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:22 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:22 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 is being set with open permissions: ugo+rw Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:22 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 Nov 05 15:21:22 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:23 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:23 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:23 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:23 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Deleted volume successfully. Nov 05 15:21:23 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info Nov 05 15:21:23 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-fc3f6164-dadc-411c-ac1b-13031ba1458d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-27ae1e6f-ea29-407c-b13d-33f40b2339a0 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-f85057f1-b569-460c-9275-3081847b64ee-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-fc3f6164-dadc-411c-ac1b-13031ba1458d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-quobyte-fc3f6164-dadc-411c-ac1b-13031ba1458d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-fc3f6164-dadc-411c-ac1b-13031ba1458d" acquired by "delete_volume" :: waited 0.013s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088c8f2-6367-4860-afe4-8d9829f34fd5]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:23 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d Nov 05 15:21:23 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:23 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:23 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info is being set with open permissions: ugo+rw Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:23 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info Nov 05 15:21:23 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:23 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:23 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.info" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:23 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d Nov 05 15:21:23 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.983s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-225375809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22092311-bcdc-427b-9217-0214ffbbd0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962b295b6fd44452abb55ea9f0e038f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:20Z,use_quota=True,user_id='e2c52c8d7f5040ee8dc9e14d2a8384d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Creating volume 22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:23 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:23 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd 1073741824 Nov 05 15:21:23 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f9032804-b679-45a3-a14a-b2ac6d8ab867 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Create snapshot completed successfully Nov 05 15:21:24 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fc3f6164-dadc-411c-ac1b-13031ba1458d" returned: 0 in 0.253s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-fc3f6164-dadc-411c-ac1b-13031ba1458d" released by "delete_volume" :: held 0.684s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Created reservations ['b3c95bdc-5103-404c-9c45-6e0ca3e49188', 'b8ef0e80-da02-47fb-b755-9f77b9b63b64', '1be14a50-7d34-41e9-b589-633c731845c4', 'baa3003d-737a-457e-92b6-55c77440d009'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:24 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:24 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:24 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd 1073741824" returned: 0 in 0.452s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:24 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd Nov 05 15:21:24 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:24 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Deleted volume successfully. Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-20f93b9a-96bd-42f7-8735-6755243c5bf3 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-fc3f6164-dadc-411c-ac1b-13031ba1458d-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-21d05854-5285-45c1-8727-58ffba412ed1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-21d05854-5285-45c1-8727-58ffba412ed1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-quobyte-21d05854-5285-45c1-8727-58ffba412ed1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:24 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-21d05854-5285-45c1-8727-58ffba412ed1" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f252bae2-685b-4592-86ec-9ccecd74c5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a999a43c92a74ba2838320c8d1318efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:19Z,use_quota=True,user_id='0cc6f65b87b249c5a02fd4eb36c23c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f050179e-bfde-4181-990f-6eb29be2cc4e),volume_type_id=f050179e-bfde-4181-990f-6eb29be2cc4e)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Creating volume f252bae2-685b-4592-86ec-9ccecd74c5f6 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:24 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e9fe2-f1fe-46b6-8f4a-d8eb1c611557]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:24 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 1073741824 Nov 05 15:21:24 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42f031c-97fc-4219-a09c-bdad2a04cd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22092311-bcdc-427b-9217-0214ffbbd0cd', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f2ebe8-117a-4150-8ecd-ac8a0fb792df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Volume volume-22092311-bcdc-427b-9217-0214ffbbd0cd (22092311-bcdc-427b-9217-0214ffbbd0cd): created successfully Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f2ebe8-117a-4150-8ecd-ac8a0fb792df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Flow 'volume_create_manager' (17cdf8c9-8790-424f-aa0b-186e578b0ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-03e4c6d0-6740-4e4f-afa5-a2b236610895 tempest-CinderUnicodeTest-590043516 None] Created volume successfully. Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (9dbab3ec-61f5-49a4-8b00-49360e7aa9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ca8511-1834-4beb-adf8-b775304befe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:24 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 Nov 05 15:21:24 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ca8511-1834-4beb-adf8-b775304befe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-329505381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fb09af-5101-4276-aca6-0db03523e7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:25Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d040f8-1ebd-43d7-8a66-2b4cae011aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d040f8-1ebd-43d7-8a66-2b4cae011aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf824913-595e-498e-befa-be9ee743ff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf824913-595e-498e-befa-be9ee743ff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98fb09af-5101-4276-aca6-0db03523e7e9', 'volume_name': 'volume-98fb09af-5101-4276-aca6-0db03523e7e9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b151bb1a-93c6-49ff-8d2b-d4d2d9175e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b151bb1a-93c6-49ff-8d2b-d4d2d9175e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5164de82-b293-45dc-bfb4-35037342901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:24 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume 98fb09af-5101-4276-aca6-0db03523e7e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98fb09af-5101-4276-aca6-0db03523e7e9', 'volume_size': 1} Nov 05 15:21:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:25 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 1073741824" returned: 0 in 0.615s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:25 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1" returned: 0 in 0.614s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:25 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1 Nov 05 15:21:25 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:25 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 Nov 05 15:21:25 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (3de7be0f-ab88-4276-91ce-fe83d53b6ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e9e5c4-5b67-4175-8e65-7ce1b91d557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e9e5c4-5b67-4175-8e65-7ce1b91d557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873762070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653985bc-d970-4a16-9ff8-6cd0db3624e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:25Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554ae9b8-85c4-4c07-b703-cf069e937b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554ae9b8-85c4-4c07-b703-cf069e937b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1b5168-5791-4413-8a58-ff7c1a153958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1b5168-5791-4413-8a58-ff7c1a153958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653985bc-d970-4a16-9ff8-6cd0db3624e9', 'volume_name': 'volume-653985bc-d970-4a16-9ff8-6cd0db3624e9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c0bec-309c-4604-bb62-2b5b7efe0b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (169c0bec-309c-4604-bb62-2b5b7efe0b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274a47e1-0dd0-4316-97c2-968eafd7f6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume 653985bc-d970-4a16-9ff8-6cd0db3624e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653985bc-d970-4a16-9ff8-6cd0db3624e9', 'volume_size': 1} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:25 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-21d05854-5285-45c1-8727-58ffba412ed1" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-21d05854-5285-45c1-8727-58ffba412ed1" released by "delete_volume" :: held 1.115s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:25 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.809s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-329505381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98fb09af-5101-4276-aca6-0db03523e7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:25Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating volume 98fb09af-5101-4276-aca6-0db03523e7e9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:25 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:25 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 1073741824 Nov 05 15:21:25 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (e6eca93a-963d-4fda-ad00-7a25ce5df175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efa4bd2-02c4-4b25-80d3-fe7c3edb04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0efa4bd2-02c4-4b25-80d3-fe7c3edb04de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625818809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c87b234-69c0-4819-94f3-11051e6e9bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:26Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de7f14f-c298-43a8-b2b9-d23eaca0b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de7f14f-c298-43a8-b2b9-d23eaca0b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24afdf99-f589-4588-983a-8ddf6b9f3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24afdf99-f589-4588-983a-8ddf6b9f3045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c87b234-69c0-4819-94f3-11051e6e9bb9', 'volume_name': 'volume-5c87b234-69c0-4819-94f3-11051e6e9bb9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834cd1c3-81ea-492b-b1c8-cf65dedb0739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834cd1c3-81ea-492b-b1c8-cf65dedb0739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7e8fba-4f42-434c-b560-9cc63322c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:25 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume 5c87b234-69c0-4819-94f3-11051e6e9bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c87b234-69c0-4819-94f3-11051e6e9bb9', 'volume_size': 1} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Attempting download of 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb ((None, [{'url': 'file:///opt/stack/data/glance/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'metadata': {}}])) to volume f252bae2-685b-4592-86ec-9ccecd74c5f6. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:21:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Created reservations ['0c3e7959-d6e3-467a-bede-d899955b3cf7', 'f180eae2-5498-4b69-8c51-649f933875f3', '27da5c27-ff1d-4da7-912d-b924e038671b', 'a2beaa4a-7187-4992-a095-b9dc2138b893'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5819e00-7dee-4b5a-a8ae-0621d199628d]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:26 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:26 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:26 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8 Nov 05 15:21:26 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (125376d3-c294-4d78-9533-41c4ec14e321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e088c7a-14d6-4212-9bfb-e5f3f5ad7b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 1073741824" returned: 0 in 0.570s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e088c7a-14d6-4212-9bfb-e5f3f5ad7b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496734027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c19d95-06e7-47fc-b2dc-554c789b1182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:26Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9944a0c3-4353-4ff4-9c4b-48029d0d7a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9944a0c3-4353-4ff4-9c4b-48029d0d7a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498695da-25ba-4f7e-984d-70b0a01aacfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498695da-25ba-4f7e-984d-70b0a01aacfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c19d95-06e7-47fc-b2dc-554c789b1182', 'volume_name': 'volume-85c19d95-06e7-47fc-b2dc-554c789b1182', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd5b87f-f1c1-444a-8350-debe0e70f65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd5b87f-f1c1-444a-8350-debe0e70f65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3935b7-9111-4ccb-b851-ea484f9f7082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume 85c19d95-06e7-47fc-b2dc-554c789b1182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c19d95-06e7-47fc-b2dc-554c789b1182', 'volume_size': 1} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:26 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.425s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:26 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Deleted volume successfully. Nov 05 15:21:26 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 Nov 05 15:21:26 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8" returned: 0 in 0.506s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-31a54d44-9603-4fd3-97e2-c12b9ec1c50d tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-21d05854-5285-45c1-8727-58ffba412ed1-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:26 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8 Nov 05 15:21:26 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:26 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.246s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Creating offline snapshot cf0a1ea0-9779-4459-8986-982e18cca685 of volume 22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5164de82-b293-45dc-bfb4-35037342901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98fb09af-5101-4276-aca6-0db03523e7e9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85ecee0-cfae-4060-9dd9-f647c825231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc660f17-4024-496c-9e10-d4c2bacaea74]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-635f04e5-8fc4-4dca-9f2a-910962cc8738-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume volume-98fb09af-5101-4276-aca6-0db03523e7e9 (98fb09af-5101-4276-aca6-0db03523e7e9): created successfully Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85ecee0-cfae-4060-9dd9-f647c825231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (9dbab3ec-61f5-49a4-8b00-49360e7aa9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:26 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (4d4c9931-2a09-4ee1-a186-6613dcc23f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8bc4d0-4ac3-4d1f-97ba-47d76b967e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-635f04e5-8fc4-4dca-9f2a-910962cc8738-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8" returned: 1 in 0.425s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_xc_i10u8' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-75de693b-7a62-444b-89fe-a754b9a75025 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created volume successfully. Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb556437-42d2-4c20-8bb0-d852bab1eb24]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:26 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd Nov 05 15:21:26 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8bc4d0-4ac3-4d1f-97ba-47d76b967e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911708421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352b7c11-6f78-4814-b0ab-5603b9858128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:27Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd22432-d91f-499d-a85c-ccb067cd2dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd22432-d91f-499d-a85c-ccb067cd2dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0416f13-f006-4011-800e-2bd1da5b5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0416f13-f006-4011-800e-2bd1da5b5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352b7c11-6f78-4814-b0ab-5603b9858128', 'volume_name': 'volume-352b7c11-6f78-4814-b0ab-5603b9858128', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e885c06a-342d-4ffb-ac7b-9a4b417161b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e885c06a-342d-4ffb-ac7b-9a4b417161b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd325f2a-445e-484b-a669-fb94a9bbd1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume 352b7c11-6f78-4814-b0ab-5603b9858128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352b7c11-6f78-4814-b0ab-5603b9858128', 'volume_size': 1} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-quobyte-635f04e5-8fc4-4dca-9f2a-910962cc8738" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-635f04e5-8fc4-4dca-9f2a-910962cc8738" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:27 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD Nov 05 15:21:27 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae38c4b-bc30-4906-b07b-31807ad41db1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 Nov 05 15:21:27 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 1G Nov 05 15:21:27 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD Nov 05 15:21:27 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738 Nov 05 15:21:27 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:27 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 1G" returned: 0 in 0.437s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22092311-bcdc-427b-9217-0214ffbbd0cd -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 Nov 05 15:21:27 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22092311-bcdc-427b-9217-0214ffbbd0cd -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 Nov 05 15:21:27 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:27 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-635f04e5-8fc4-4dca-9f2a-910962cc8738" returned: 0 in 0.281s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-635f04e5-8fc4-4dca-9f2a-910962cc8738" released by "delete_volume" :: held 0.741s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Created reservations ['76bd773f-0b6a-4481-a6ba-d27cdfa8d84e', '5f80ebf7-e149-4a0e-bd16-241ea6e6823b', 'aaafb71f-df9b-473a-ab88-5de4be957332', '4bd7be41-9cb2-423f-860b-f859ac300805'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:27 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:27 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-b40453a3-99e3-478f-8973-7e5af532bc6d-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:28 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22092311-bcdc-427b-9217-0214ffbbd0cd -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 is being set with open permissions: ugo+rw Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-b40453a3-99e3-478f-8973-7e5af532bc6d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:28 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 Nov 05 15:21:28 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "cinder-quobyte-b40453a3-99e3-478f-8973-7e5af532bc6d" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-b40453a3-99e3-478f-8973-7e5af532bc6d" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a46c1-e1ad-48fa-b708-9227c1bce1da]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:28 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.333s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Deleted volume successfully. Nov 05 15:21:28 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6" returned: 0 in 0.608s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb_w2352tbldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:21:28 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d279a05a-140e-4f2f-ba48-cba8bc24591e tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-635f04e5-8fc4-4dca-9f2a-910962cc8738-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:28 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 1G Nov 05 15:21:28 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d Nov 05 15:21:28 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685" returned: 0 in 0.333s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:28 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info Nov 05 15:21:28 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d" returned: 0 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:28 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 1G" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Downloaded image 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb ((None, [{'url': 'file:///opt/stack/data/glance/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'metadata': {}}])) to volume f252bae2-685b-4592-86ec-9ccecd74c5f6 successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Temporary image 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb for user 0cc6f65b87b249c5a02fd4eb36c23c19 is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Marking volume f252bae2-685b-4592-86ec-9ccecd74c5f6 as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:21:28 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d Nov 05 15:21:28 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Copying metadata from image 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb to f252bae2-685b-4592-86ec-9ccecd74c5f6. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Creating volume glance metadata for volume f252bae2-685b-4592-86ec-9ccecd74c5f6 backed by image 7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '28a6345949b9e2099a3006f7eca94884', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a549c64-85ad-481b-8c3d-5604c1ba9eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f252bae2-685b-4592-86ec-9ccecd74c5f6', 'volume_size': 1, 'image_id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28a6345949b9e2099a3006f7eca94884', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a999a43c92a74ba2838320c8d1318efb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2842f543ca8b4c0a9ebd465aff47b2f533d199a60f06cbc850cea91ffd05b548e8c83e44c2a41f05a4e74066d821313fe326f8d797484ae83f3f2435835c165', 'id': '7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb', 'created_at': datetime.datetime(2026, 11, 5, 14, 21, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 21, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b22c0c2-eb3c-46bb-9fe7-fad8c1ac99bb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522d517f-5b4a-4980-a677-ac3edc4a5c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:28 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info" returned: 0 in 0.292s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info is being set with open permissions: ugo+rw Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:28 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Volume volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 (f252bae2-685b-4592-86ec-9ccecd74c5f6): created successfully Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522d517f-5b4a-4980-a677-ac3edc4a5c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Flow 'volume_create_manager' (baca5503-f330-49e1-8dd6-c1b85f576e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:28 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info Nov 05 15:21:28 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4f54a326-0e14-4ccf-b58c-df9f5d77d96d tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Created volume successfully. Nov 05 15:21:28 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b40453a3-99e3-478f-8973-7e5af532bc6d" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-quobyte-b40453a3-99e3-478f-8973-7e5af532bc6d" released by "delete_volume" :: held 0.722s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Created reservations ['19be008a-dd9b-4176-80b6-0759e070a892', '9ff3b403-3628-49b9-9511-eefa8599fb64', 'bcaa5b95-1ae3-40a2-8262-ded28a8a3ea0', 'ac57dc00-21ba-43cc-a670-4c78f8193db6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:28 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.info" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.403s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1873762070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653985bc-d970-4a16-9ff8-6cd0db3624e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:25Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating volume 653985bc-d970-4a16-9ff8-6cd0db3624e9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:29 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 1073741824 Nov 05 15:21:29 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:29 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:29 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-efd8ed3b-0390-4463-ad1d-a113ea35412c tempest-CinderUnicodeTest-590043516 None] Create snapshot completed successfully Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Acquiring lock "cinder-f252bae2-685b-4592-86ec-9ccecd74c5f6-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "cinder-f252bae2-685b-4592-86ec-9ccecd74c5f6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Acquiring lock "cinder-quobyte-f252bae2-685b-4592-86ec-9ccecd74c5f6" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "cinder-quobyte-f252bae2-685b-4592-86ec-9ccecd74c5f6" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c7795a-aacc-4125-bdf5-d78fb58cca44]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:29 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Deleted volume successfully. Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66839d39-429e-4de4-8fed-42fec0cd26a6 tempest-CreateVolumesFromImageTest-1972530542 None] Lock "cinder-b40453a3-99e3-478f-8973-7e5af532bc6d-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:29 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 Nov 05 15:21:29 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:29 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 1073741824" returned: 0 in 0.592s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:29 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 Nov 05 15:21:29 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-cf0a1ea0-9779-4459-8986-982e18cca685-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Lock "cinder-cf0a1ea0-9779-4459-8986-982e18cca685-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-quobyte-22092311-bcdc-427b-9217-0214ffbbd0cd" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-22092311-bcdc-427b-9217-0214ffbbd0cd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-quobyte-cf0a1ea0-9779-4459-8986-982e18cca685" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-cf0a1ea0-9779-4459-8986-982e18cca685" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Deleting offline snapshot cf0a1ea0-9779-4459-8986-982e18cca685 of volume 22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] snapshot_file for this snap is: volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:21:29 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6" returned: 0 in 0.469s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65b24b6-3f8d-48ad-81ee-9333b082087a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:29 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6 Nov 05 15:21:29 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:29 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 Nov 05 15:21:29 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:29 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9" returned: 0 in 0.316s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.056s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-625818809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c87b234-69c0-4819-94f3-11051e6e9bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:26Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating volume 5c87b234-69c0-4819-94f3-11051e6e9bb9 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274a47e1-0dd0-4316-97c2-968eafd7f6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653985bc-d970-4a16-9ff8-6cd0db3624e9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:30 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 1073741824 Nov 05 15:21:30 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e599379-41a1-45eb-8e34-f07d4fe2d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 (653985bc-d970-4a16-9ff8-6cd0db3624e9): created successfully Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e599379-41a1-45eb-8e34-f07d4fe2d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (3de7be0f-ab88-4276-91ce-fe83d53b6ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-aa271af9-d3c5-47b6-861a-5b91f04087a7 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created volume successfully. Nov 05 15:21:30 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f252bae2-685b-4592-86ec-9ccecd74c5f6" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "cinder-quobyte-f252bae2-685b-4592-86ec-9ccecd74c5f6" released by "delete_volume" :: held 0.865s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Created reservations ['26938ef5-2480-4e8e-a89f-59394a383095', 'c285caf5-4801-4bba-aa05-c729ad1bbfaf', '44222bdd-e118-432f-9462-59cc3009d900', 'ada55a83-42c8-4acb-9b49-13965d00fb69'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:30 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22092311-bcdc-427b-9217-0214ffbbd0cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c79cc-5017-47c6-9bea-3ff8d2198102]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:30 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:30 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:30 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd Nov 05 15:21:30 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:30 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 1073741824" returned: 0 in 0.776s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:30 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.360s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Deleted volume successfully. Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9f4f683d-a8d1-4467-9eb7-88a862700614 tempest-VolumeAndVolumeTypeFromImageTest-1521543694 None] Lock "cinder-f252bae2-685b-4592-86ec-9ccecd74c5f6-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:30 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 Nov 05 15:21:30 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:30 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd" returned: 0 in 0.547s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:30 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 Nov 05 15:21:30 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:31 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9" returned: 0 in 0.462s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.875s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496734027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c19d95-06e7-47fc-b2dc-554c789b1182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:26Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating volume 85c19d95-06e7-47fc-b2dc-554c789b1182 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:31 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:31 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 1073741824 Nov 05 15:21:31 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7e8fba-4f42-434c-b560-9cc63322c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c87b234-69c0-4819-94f3-11051e6e9bb9', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1157e609-8840-442e-9d91-6776cf7a3773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:31 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 (5c87b234-69c0-4819-94f3-11051e6e9bb9): created successfully Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1157e609-8840-442e-9d91-6776cf7a3773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (e6eca93a-963d-4fda-ad00-7a25ce5df175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:31 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-098ce7ce-0d7c-416f-836c-0ef7cb6bf633 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created volume successfully. Nov 05 15:21:31 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685" returned: 0 in 0.755s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:31 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685 Nov 05 15:21:31 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:31 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 1073741824" returned: 0 in 0.625s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:32 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd.cf0a1ea0-9779-4459-8986-982e18cca685" returned: 0 in 0.375s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:32 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 Nov 05 15:21:32 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-cf0a1ea0-9779-4459-8986-982e18cca685" released by "_delete_snapshot" :: held 2.313s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-22092311-bcdc-427b-9217-0214ffbbd0cd" released by "delete_snapshot" :: held 2.345s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Created reservations ['0cf24491-1e62-4afc-89ef-11c8dcf63546', 'a43ea0e6-bbb9-4cb0-b838-e31b8540bf95', 'a494edd9-7e55-4e66-a613-299617f765a0', 'ea8b6ebb-9e5c-4528-8f72-2fdb1fd0813b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Delete snapshot completed successfully. Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f2c4d91d-aa7b-4d57-958c-d2ad72e3bfe3 tempest-CinderUnicodeTest-590043516 None] Lock "cinder-cf0a1ea0-9779-4459-8986-982e18cca685-delete_snapshot" released by "delete_snapshot" :: held 2.517s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:32 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182" returned: 0 in 0.335s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.316s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911708421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352b7c11-6f78-4814-b0ab-5603b9858128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ead2a044b48669fbc27cb4992ceed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:27Z,use_quota=True,user_id='c493754af88947baafaaf970a8e8d594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Creating volume 352b7c11-6f78-4814-b0ab-5603b9858128 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:32 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3935b7-9111-4ccb-b851-ea484f9f7082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c19d95-06e7-47fc-b2dc-554c789b1182', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:32 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 1073741824 Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fbed05-9142-40db-b350-2485f55cd6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:32 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume volume-85c19d95-06e7-47fc-b2dc-554c789b1182 (85c19d95-06e7-47fc-b2dc-554c789b1182): created successfully Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76fbed05-9142-40db-b350-2485f55cd6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (125376d3-c294-4d78-9533-41c4ec14e321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9cc6140e-9e80-467a-a791-3dec45a89734 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created volume successfully. Nov 05 15:21:32 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 1073741824" returned: 0 in 0.561s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-22092311-bcdc-427b-9217-0214ffbbd0cd-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Lock "cinder-22092311-bcdc-427b-9217-0214ffbbd0cd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:33 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 Nov 05 15:21:33 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-quobyte-22092311-bcdc-427b-9217-0214ffbbd0cd" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-22092311-bcdc-427b-9217-0214ffbbd0cd" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36061d-34dd-41d0-8145-4aae38c1c530]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:33 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd Nov 05 15:21:33 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:33 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128" returned: 0 in 0.308s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd325f2a-445e-484b-a669-fb94a9bbd1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352b7c11-6f78-4814-b0ab-5603b9858128', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb9d92b-dde3-4322-968d-7811bd583e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:33 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Volume volume-352b7c11-6f78-4814-b0ab-5603b9858128 (352b7c11-6f78-4814-b0ab-5603b9858128): created successfully Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb9d92b-dde3-4322-968d-7811bd583e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Flow 'volume_create_manager' (4d4c9931-2a09-4ee1-a186-6613dcc23f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e8eee41d-84df-4810-92df-9842ddf14bdc tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created volume successfully. Nov 05 15:21:33 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd" returned: 0 in 0.502s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:33 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd Nov 05 15:21:33 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-352b7c11-6f78-4814-b0ab-5603b9858128-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-352b7c11-6f78-4814-b0ab-5603b9858128-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (b8143fde-e3bb-4584-bb8a-c7a334b7fa55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0626bed-c630-4ec3-836c-567312009474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-352b7c11-6f78-4814-b0ab-5603b9858128" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:33 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:33 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0626bed-c630-4ec3-836c-567312009474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574162102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f413550a-e614-40be-b6f0-bcfb33fde461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:34Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628e7345-ce2b-4a42-8054-43f882af12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628e7345-ce2b-4a42-8054-43f882af12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64b9c39-0e11-4a5e-9221-dfd95e853c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64b9c39-0e11-4a5e-9221-dfd95e853c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f413550a-e614-40be-b6f0-bcfb33fde461', 'volume_name': 'volume-f413550a-e614-40be-b6f0-bcfb33fde461', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d1fce8-8785-41a2-b355-b3eded505dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d1fce8-8785-41a2-b355-b3eded505dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d677a9ca-1ab3-4f7d-bcb7-6ff7451c98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:34 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume f413550a-e614-40be-b6f0-bcfb33fde461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f413550a-e614-40be-b6f0-bcfb33fde461', 'volume_size': 1} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574162102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f413550a-e614-40be-b6f0-bcfb33fde461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:34Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Creating volume f413550a-e614-40be-b6f0-bcfb33fde461 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-22092311-bcdc-427b-9217-0214ffbbd0cd" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:34 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 1073741824 Nov 05 15:21:34 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-352b7c11-6f78-4814-b0ab-5603b9858128" acquired by "delete_volume" :: waited 0.125s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-22092311-bcdc-427b-9217-0214ffbbd0cd" released by "delete_volume" :: held 1.059s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7631e379-035d-4519-a201-282e98af8d1c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Created reservations ['08ecab07-6d4f-4eef-8a97-4b6333d9fc65', '8ca43350-dee4-4180-be60-beae0822547a', '9e673201-df7f-46bd-8578-3a189acff9db', 'd4a97530-6175-4afe-87f6-a551e35774a6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:34 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 Nov 05 15:21:34 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:34 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:34 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:34 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:34 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:34 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 1073741824" returned: 0 in 0.608s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Deleted volume successfully. Nov 05 15:21:34 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128 Nov 05 15:21:34 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-33abcc2a-9992-4c84-b764-39ae9060fecf tempest-CinderUnicodeTest-590043516 None] Lock "cinder-22092311-bcdc-427b-9217-0214ffbbd0cd-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:34 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 Nov 05 15:21:34 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:34 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-352b7c11-6f78-4814-b0ab-5603b9858128" returned: 0 in 0.356s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-352b7c11-6f78-4814-b0ab-5603b9858128" released by "delete_volume" :: held 0.892s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:35 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d677a9ca-1ab3-4f7d-bcb7-6ff7451c98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f413550a-e614-40be-b6f0-bcfb33fde461', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a370e655-2eca-461e-b039-312c8dd8d1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['de8919fe-01c8-4776-a6fa-5775b0bb55cf', '96965a86-19c2-43dc-b465-722afe785edd', '87904149-4efc-49af-b49b-e40931d2b2af', '50b0430e-4c5c-4808-bd89-164e68793401'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume volume-f413550a-e614-40be-b6f0-bcfb33fde461 (f413550a-e614-40be-b6f0-bcfb33fde461): created successfully Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a370e655-2eca-461e-b039-312c8dd8d1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (b8143fde-e3bb-4584-bb8a-c7a334b7fa55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fd32e0b5-ae88-4a55-b375-b875641b6ae4 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created volume successfully. Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:35 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:35 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-03346c3c-3888-4ef7-8868-df6dd8e3a592-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Lock "cinder-03346c3c-3888-4ef7-8868-df6dd8e3a592-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Acquiring lock "cinder-quobyte-03346c3c-3888-4ef7-8868-df6dd8e3a592" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-03346c3c-3888-4ef7-8868-df6dd8e3a592" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48785de-44ab-4e27-8ed0-bb2c2e2de524]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:35 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleted volume successfully. Nov 05 15:21:35 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 Nov 05 15:21:35 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-d525960b-d490-465c-82ce-5cb73dd8d6f6 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-352b7c11-6f78-4814-b0ab-5603b9858128-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:35 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:35 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592 Nov 05 15:21:35 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:36 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-03346c3c-3888-4ef7-8868-df6dd8e3a592" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Lock "cinder-quobyte-03346c3c-3888-4ef7-8868-df6dd8e3a592" released by "delete_volume" :: held 0.748s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-85c19d95-06e7-47fc-b2dc-554c789b1182-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-85c19d95-06e7-47fc-b2dc-554c789b1182-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Created reservations ['178f9f5c-6a8e-43ea-a36a-4e266091a4cd', '5f76945a-0085-4d1f-ae6f-3a3e0dc1b481', '5493fef5-511d-4b1c-867c-82c85f88ce69', '8917140b-7b31-4326-9eda-63821df71ea6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-85c19d95-06e7-47fc-b2dc-554c789b1182" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-85c19d95-06e7-47fc-b2dc-554c789b1182" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4481273-ffe5-4778-9800-e5a4b3f166fb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:36 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:36 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:36 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 Nov 05 15:21:36 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (51968141-f361-4d9b-888a-fb6a6636d049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:36 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382c29b4-ffea-4632-ae51-5adf33331be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:36 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Deleted volume successfully. Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (382c29b4-ffea-4632-ae51-5adf33331be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958375868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd68e26-1d08-421c-a14e-e6b45d32caf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:37Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84413dd5-52a0-47a0-8e95-387e155719eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84413dd5-52a0-47a0-8e95-387e155719eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29595289-704c-4c67-bb4e-fdf38f0f8151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29595289-704c-4c67-bb4e-fdf38f0f8151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd68e26-1d08-421c-a14e-e6b45d32caf2', 'volume_name': 'volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041df5f4-80ea-4b20-a8c8-5bd94002da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041df5f4-80ea-4b20-a8c8-5bd94002da36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe68dd2-4062-448b-821e-b685c4f75d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:36 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume fcd68e26-1d08-421c-a14e-e6b45d32caf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2', 'volume_size': 1} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958375868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd68e26-1d08-421c-a14e-e6b45d32caf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:37Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Creating volume fcd68e26-1d08-421c-a14e-e6b45d32caf2 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:36 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-416f1f81-7e4d-4874-b9d4-81ea39c929da tempest-CinderUnicodeTest-590043516 None] Lock "cinder-03346c3c-3888-4ef7-8868-df6dd8e3a592-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:37 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 1073741824 Nov 05 15:21:37 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:37 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182" returned: 0 in 0.857s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:37 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182 Nov 05 15:21:37 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (108d2ee4-5fa8-4bde-8b5a-d2df5eac6271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eee96b-01ca-4256-885d-cfd358ab6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13eee96b-01ca-4256-885d-cfd358ab6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260944116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83be189f-a897-4434-a407-dcce0a46f520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:37Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec660b4f-d473-4865-9a11-f7cb533b39b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec660b4f-d473-4865-9a11-f7cb533b39b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea76434-0ee6-497f-8b81-fef755a9b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea76434-0ee6-497f-8b81-fef755a9b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83be189f-a897-4434-a407-dcce0a46f520', 'volume_name': 'volume-83be189f-a897-4434-a407-dcce0a46f520', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fedd31b-ff9e-433b-9c0e-da2ba0f48ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fedd31b-ff9e-433b-9c0e-da2ba0f48ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c47d77-1bde-4bd1-8e48-8cc726c35ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:37 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume 83be189f-a897-4434-a407-dcce0a46f520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83be189f-a897-4434-a407-dcce0a46f520', 'volume_size': 1} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:37 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-85c19d95-06e7-47fc-b2dc-554c789b1182" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-85c19d95-06e7-47fc-b2dc-554c789b1182" released by "delete_volume" :: held 1.398s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['408b048e-6660-40bd-8ef5-7993fc056645', '1bb629b5-48c5-4b3c-8235-a43e102f9b30', '1b7d5c3f-936b-4a9d-8c23-5978b640029f', 'c37c8e6d-740c-48c4-b4f9-0371c469f9c3'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:37 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:37 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:37 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 1073741824" returned: 0 in 0.936s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:38 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 Nov 05 15:21:38 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:38 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (e4896d21-a264-4aca-a3fb-45582ced2ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf7e46-d0f4-48e8-ad39-57c643c21a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleted volume successfully. Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf7e46-d0f4-48e8-ad39-57c643c21a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72293908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c66cb37-64e5-4910-bbb8-ee1325f79d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:38Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01643e0-c159-42ae-b7b9-423925836be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01643e0-c159-42ae-b7b9-423925836be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd94f0-728f-4619-a6d1-e3805e70868c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffd94f0-728f-4619-a6d1-e3805e70868c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c66cb37-64e5-4910-bbb8-ee1325f79d5c', 'volume_name': 'volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad11ba4-abf4-4d7a-ae43-a183bf7d52fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dad11ba4-abf4-4d7a-ae43-a183bf7d52fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64267ca-2ca9-4f00-8e4a-62b9db2cda62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume 3c66cb37-64e5-4910-bbb8-ee1325f79d5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c', 'volume_size': 1} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab716180-110c-4fe6-a705-d6b59bd46bcf tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-85c19d95-06e7-47fc-b2dc-554c789b1182-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:38 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260944116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83be189f-a897-4434-a407-dcce0a46f520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:37Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Creating volume 83be189f-a897-4434-a407-dcce0a46f520 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:38 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-5c87b234-69c0-4819-94f3-11051e6e9bb9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:38 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 1073741824 Nov 05 15:21:38 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe68dd2-4062-448b-821e-b685c4f75d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ff8b16-215f-4a63-947c-663a6d3bfe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-5c87b234-69c0-4819-94f3-11051e6e9bb9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 (fcd68e26-1d08-421c-a14e-e6b45d32caf2): created successfully Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ff8b16-215f-4a63-947c-663a6d3bfe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (51968141-f361-4d9b-888a-fb6a6636d049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4c33a667-5941-40da-8cd4-5f498c91d80a tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created volume successfully. Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (84c06b38-0975-4217-8d30-b5c293c9a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096b318c-bd46-4e98-9a6f-10cba03d5f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-5c87b234-69c0-4819-94f3-11051e6e9bb9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096b318c-bd46-4e98-9a6f-10cba03d5f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18724095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ef7720-0dc0-434c-88b6-2ac9c182b8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:39Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed49ab83-d568-4d2f-bae1-2101bad45a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed49ab83-d568-4d2f-bae1-2101bad45a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adbec78-8734-4a2e-b9ba-2e89e9b59e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adbec78-8734-4a2e-b9ba-2e89e9b59e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ef7720-0dc0-434c-88b6-2ac9c182b8e5', 'volume_name': 'volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b153a099-03e7-4a4b-a0a9-338c90b2cf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b153a099-03e7-4a4b-a0a9-338c90b2cf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76db75d-94fa-495d-b25a-6b9ef64dadd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:38 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume 12ef7720-0dc0-434c-88b6-2ac9c182b8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5', 'volume_size': 1} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-5c87b234-69c0-4819-94f3-11051e6e9bb9" acquired by "delete_volume" :: waited 0.115s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d642a13-a52a-4da5-951a-d33eac359ad1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:39 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 Nov 05 15:21:39 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:39 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:39 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:39 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 1073741824" returned: 0 in 0.891s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (dd1017da-b8f0-4ccd-8d5c-c80c4d25fdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42272031-fe28-408e-a23d-ef95a649bada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42272031-fe28-408e-a23d-ef95a649bada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956702717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e08b2ec-e4a6-4569-a851-73593dd0d502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:39Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:39 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 Nov 05 15:21:39 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2c087b-6a56-4a42-b483-9e62393e98b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2c087b-6a56-4a42-b483-9e62393e98b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4dd4dd-8004-4dd7-9f57-c0b39842fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:39 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4dd4dd-8004-4dd7-9f57-c0b39842fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e08b2ec-e4a6-4569-a851-73593dd0d502', 'volume_name': 'volume-5e08b2ec-e4a6-4569-a851-73593dd0d502', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d1be8-da0f-4d58-a840-7a7ea8ce3525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549d1be8-da0f-4d58-a840-7a7ea8ce3525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59f90d0-c955-4ef2-8e66-2fbe8190cf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume 5e08b2ec-e4a6-4569-a851-73593dd0d502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e08b2ec-e4a6-4569-a851-73593dd0d502', 'volume_size': 1} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.453s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:21:39 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9" returned: 0 in 0.645s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:39 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9 Nov 05 15:21:39 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:39 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.384s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72293908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c66cb37-64e5-4910-bbb8-ee1325f79d5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:38Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Creating volume 3c66cb37-64e5-4910-bbb8-ee1325f79d5c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:39 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c 1073741824 Nov 05 15:21:39 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71c47d77-1bde-4bd1-8e48-8cc726c35ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83be189f-a897-4434-a407-dcce0a46f520', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226298b3-5e94-476c-8c64-8066f297f4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume volume-83be189f-a897-4434-a407-dcce0a46f520 (83be189f-a897-4434-a407-dcce0a46f520): created successfully Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226298b3-5e94-476c-8c64-8066f297f4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (108d2ee4-5fa8-4bde-8b5a-d2df5eac6271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:39 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ee820dc5-7c50-4397-a257-3f5855121c6c tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created volume successfully. Nov 05 15:21:39 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5c87b234-69c0-4819-94f3-11051e6e9bb9" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-5c87b234-69c0-4819-94f3-11051e6e9bb9" released by "delete_volume" :: held 1.064s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['edb75425-3855-424a-8014-288a8fbc8166', 'fcfd4f5c-e8b5-4089-9b0e-44d9279aeca6', '8ae1971c-83ab-49b2-9b0f-55cfaf274fea', '34c74edb-7d7e-4844-8b6b-00094835c82c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:40 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:40 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:40 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c 1073741824" returned: 0 in 0.647s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:40 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleted volume successfully. Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef10091f-badd-4a83-b68b-4155aca63045 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-5c87b234-69c0-4819-94f3-11051e6e9bb9-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:40 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c Nov 05 15:21:40 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:40 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.921s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-18724095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ef7720-0dc0-434c-88b6-2ac9c182b8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:39Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Creating volume 12ef7720-0dc0-434c-88b6-2ac9c182b8e5 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64267ca-2ca9-4f00-8e4a-62b9db2cda62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:40 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 1073741824 Nov 05 15:21:40 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f8f35a-fad1-437d-a902-6fa73f6ceff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-653985bc-d970-4a16-9ff8-6cd0db3624e9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c (3c66cb37-64e5-4910-bbb8-ee1325f79d5c): created successfully Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f8f35a-fad1-437d-a902-6fa73f6ceff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (e4896d21-a264-4aca-a3fb-45582ced2ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-653985bc-d970-4a16-9ff8-6cd0db3624e9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a6c619e2-e590-439f-b2bc-f9a9a6af843f tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created volume successfully. Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-653985bc-d970-4a16-9ff8-6cd0db3624e9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-653985bc-d970-4a16-9ff8-6cd0db3624e9" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c1e6b6-d820-429c-a922-8fef8c2b3bad]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:41 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 Nov 05 15:21:41 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Flow 'volume_create_manager' (5196e69a-ca54-421f-b079-e3cd8c9bbf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568c12eb-9ba1-463b-b9f6-ae2ea211a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:41 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 1073741824" returned: 0 in 0.669s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568c12eb-9ba1-463b-b9f6-ae2ea211a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971874dc-1fdf-4202-af93-bb8f351b28dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d2c36e0c6b484897f1902f571d8173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:41Z,use_quota=True,user_id='27738981fed14a72b935f1d39742d14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99af41ee-4e48-49d7-b120-b5d1876027f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99af41ee-4e48-49d7-b120-b5d1876027f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f172bb9-a748-435f-86ab-8468c15d3453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.image.glance [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Creating Keystone auth plugin from conf {{(pid=87126) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 15:21:41 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9" returned: 0 in 0.479s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:41 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9 Nov 05 15:21:41 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:41 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 Nov 05 15:21:41 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:41 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-653985bc-d970-4a16-9ff8-6cd0db3624e9" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-653985bc-d970-4a16-9ff8-6cd0db3624e9" released by "delete_volume" :: held 0.874s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:41 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.370s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956702717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e08b2ec-e4a6-4569-a851-73593dd0d502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16933df9d4e341f4bb5caf4fc78825e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:39Z,use_quota=True,user_id='7f8130b59aa9476a8b8ce537b4d60a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Creating volume 5e08b2ec-e4a6-4569-a851-73593dd0d502 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:41 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:41 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 1073741824 Nov 05 15:21:41 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76db75d-94fa-495d-b25a-6b9ef64dadd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6482c778-dbb2-4da5-b25b-e0e76e65d490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 (12ef7720-0dc0-434c-88b6-2ac9c182b8e5): created successfully Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6482c778-dbb2-4da5-b25b-e0e76e65d490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (84c06b38-0975-4217-8d30-b5c293c9a816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-19765c4a-a5e6-47a6-9f87-d4c09d9ce7ad tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created volume successfully. Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['85d79c92-d177-4aa4-a201-d0a7c0dd106a', '75cd9376-fd0d-481d-8de3-ad360ed37c28', '6f83f63a-a244-48a1-81d7-e905390e6db1', '86246ff0-f64f-4944-b835-e824118aa2cc'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f172bb9-a748-435f-86ab-8468c15d3453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '971874dc-1fdf-4202-af93-bb8f351b28dd', 'volume_name': 'volume-971874dc-1fdf-4202-af93-bb8f351b28dd', 'volume_size': 1, 'image_id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20b5c33e82768daacf8542407b36606a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d2c36e0c6b484897f1902f571d8173', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2a1c3102a2801ce5d1160e9d6dff8888f54d48f65716dd8797b50a410688f067a06c364549a6c3f0142dc1da56a3064cb034615923ea12bb2305e44d2837ef4', 'id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'created_at': datetime.datetime(2026, 11, 5, 14, 21, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57fa748-97e2-493d-9ace-51a2ccca3156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57fa748-97e2-493d-9ace-51a2ccca3156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244c277d-957a-4387-9346-592ad3ff628c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Volume 971874dc-1fdf-4202-af93-bb8f351b28dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-971874dc-1fdf-4202-af93-bb8f351b28dd', 'volume_size': 1, 'image_id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20b5c33e82768daacf8542407b36606a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d2c36e0c6b484897f1902f571d8173', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2a1c3102a2801ce5d1160e9d6dff8888f54d48f65716dd8797b50a410688f067a06c364549a6c3f0142dc1da56a3064cb034615923ea12bb2305e44d2837ef4', 'id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'created_at': datetime.datetime(2026, 11, 5, 14, 21, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234/file', 'properties': {}}, 'image_service': } Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Trying to clone 971874dc-1fdf-4202-af93-bb8f351b28dd from image fb75cd7d-f431-4b5a-89c6-5408dbb4c234 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'metadata': {}}]). {{(pid=87126) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:42 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:42 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Image download 0.00 MB at 0.00 MB/s Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bf5bb8-b140-476c-9301-7a1cb02465a2]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:42 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD Nov 05 15:21:42 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:42 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:42 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 1073741824" returned: 0 in 0.604s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleted volume successfully. Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-131bb865-b4e8-4c08-b348-63082b25599a tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-653985bc-d970-4a16-9ff8-6cd0db3624e9-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:42 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 Nov 05 15:21:42 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:42 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:42 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD Nov 05 15:21:42 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:42 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59f90d0-c955-4ef2-8e66-2fbe8190cf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e08b2ec-e4a6-4569-a851-73593dd0d502', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6713545-d22d-4d31-95de-4fa1462f1d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Volume volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 (5e08b2ec-e4a6-4569-a851-73593dd0d502): created successfully Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6713545-d22d-4d31-95de-4fa1462f1d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Flow 'volume_create_manager' (dd1017da-b8f0-4ccd-8d5c-c80c4d25fdfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-d78243fb-437c-4f25-b210-56c3689c32a1 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created volume successfully. Nov 05 15:21:43 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Temporary image fb75cd7d-f431-4b5a-89c6-5408dbb4c234 is fetched for user 27738981fed14a72b935f1d39742d14d. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-98fb09af-5101-4276-aca6-0db03523e7e9-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-98fb09af-5101-4276-aca6-0db03523e7e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f76be-5fe4-41e1-9b46-c940b4588bec]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-98fb09af-5101-4276-aca6-0db03523e7e9" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-98fb09af-5101-4276-aca6-0db03523e7e9" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a35da2-9a96-4b43-8b74-45afb18dd773]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:43 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD Nov 05 15:21:43 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:43 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 Nov 05 15:21:43 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:43 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:43 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD Nov 05 15:21:43 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:43 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9" returned: 0 in 0.399s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:43 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9 Nov 05 15:21:43 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:43 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971874dc-1fdf-4202-af93-bb8f351b28dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74d2c36e0c6b484897f1902f571d8173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:41Z,use_quota=True,user_id='27738981fed14a72b935f1d39742d14d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Creating volume 971874dc-1fdf-4202-af93-bb8f351b28dd {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:43 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-5e08b2ec-e4a6-4569-a851-73593dd0d502-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:44 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd 1073741824 Nov 05 15:21:44 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-5e08b2ec-e4a6-4569-a851-73593dd0d502-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:44 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-98fb09af-5101-4276-aca6-0db03523e7e9" returned: 0 in 0.332s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-98fb09af-5101-4276-aca6-0db03523e7e9" released by "delete_volume" :: held 0.798s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-quobyte-5e08b2ec-e4a6-4569-a851-73593dd0d502" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-5e08b2ec-e4a6-4569-a851-73593dd0d502" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e90920-de64-4b23-b94d-81d78860a4e8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['4cde3439-c561-4b10-b578-30f5adf8cf65', '76f5ca7a-7a26-4441-ac6b-8ba3e780536c', '12728fda-d172-4026-bc62-035fa08b3915', '9ace5167-a068-4e9a-ba46-e288c0e8652e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:44 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 Nov 05 15:21:44 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:44 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:44 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-15492af3-73dc-45b8-8096-9190a9defc81-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-15492af3-73dc-45b8-8096-9190a9defc81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-15492af3-73dc-45b8-8096-9190a9defc81" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-15492af3-73dc-45b8-8096-9190a9defc81" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleting offline snapshot 15492af3-73dc-45b8-8096-9190a9defc81 of volume 6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] snapshot_file for this snap is: volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee25ad97-5f67-42fa-9e14-4ae494178027]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:44 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd 1073741824" returned: 0 in 0.678s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:44 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:44 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502" returned: 0 in 0.526s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:44 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleted volume successfully. Nov 05 15:21:44 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502 Nov 05 15:21:44 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-fbacfd3e-6bb7-4bc2-982d-bde4e691ecac tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-98fb09af-5101-4276-aca6-0db03523e7e9-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:44 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 Nov 05 15:21:44 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:44 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd Nov 05 15:21:44 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:45 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5e08b2ec-e4a6-4569-a851-73593dd0d502" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:45 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-5e08b2ec-e4a6-4569-a851-73593dd0d502" released by "delete_volume" :: held 0.941s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81" returned: 0 in 0.454s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Attempting download of fb75cd7d-f431-4b5a-89c6-5408dbb4c234 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'metadata': {}}])) to volume 971874dc-1fdf-4202-af93-bb8f351b28dd. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e01cff2-7b90-433b-a2f8-bb810b8c9190]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c75331-357b-4143-986f-861cbbc587e2]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created reservations ['e44babe5-d64e-46ef-9579-220f0638f114', 'e82dd386-4384-4d1c-a46c-d1b43e43d1f6', '3e48fe6a-3650-425b-b524-70e35880ff36', 'e66870bb-b1c5-460e-8e31-35fc62b0fee7'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:45 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f Nov 05 15:21:45 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:45 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd Nov 05 15:21:45 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:45 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:45 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:45 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" returned: 0 in 0.471s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:45 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.298s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Deleted volume successfully. Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd" returned: 0 in 0.477s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-de8fbd53-e4df-4ffc-9b33-1cbd9a7c7870 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-5e08b2ec-e4a6-4569-a851-73593dd0d502-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:45 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd Nov 05 15:21:45 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:45 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81" returned: 0 in 0.407s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:46 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81 Nov 05 15:21:46 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:46 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd" returned: 1 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_l9b405nd' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[78120609-3482-4eac-ba91-dc38442e3c3d]: (4, 'raw') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:46 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD Nov 05 15:21:46 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:46 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f.15492af3-73dc-45b8-8096-9190a9defc81" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-12ef7720-0dc0-434c-88b6-2ac9c182b8e5-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-15492af3-73dc-45b8-8096-9190a9defc81" released by "_delete_snapshot" :: held 1.858s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-12ef7720-0dc0-434c-88b6-2ac9c182b8e5-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" released by "delete_snapshot" :: held 1.913s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-quobyte-12ef7720-0dc0-434c-88b6-2ac9c182b8e5" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-12ef7720-0dc0-434c-88b6-2ac9c182b8e5" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:46 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9aa0ac4-1720-4d24-864e-037133ea26f5]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['d99ff336-9440-40f1-853f-93ea27a183f7', 'c2435001-fe7d-4057-be75-670934a6ec24', '40643931-87dd-4fca-b68a-9f56e5b6df52', '14aa586b-db4e-49ef-9fba-9c989ca83283'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:46 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD Nov 05 15:21:46 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:46 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 Nov 05 15:21:46 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Delete snapshot completed successfully. Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ab023042-edef-434f-af0d-e7c646ffadb5 tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-15492af3-73dc-45b8-8096-9190a9defc81-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:46 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] fb75cd7d-f431-4b5a-89c6-5408dbb4c234 was raw, converting to qcow2 {{(pid=87126) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:46 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd Nov 05 15:21:46 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:46 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5" returned: 0 in 0.442s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:46 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5 Nov 05 15:21:46 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:47 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12ef7720-0dc0-434c-88b6-2ac9c182b8e5" returned: 0 in 0.274s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-12ef7720-0dc0-434c-88b6-2ac9c182b8e5" released by "delete_volume" :: held 0.777s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created reservations ['5e46a677-cafa-43a5-a2da-4e800332a9bb', '709eb78c-625a-4f53-ad38-b848815921e9', 'bda0f0c4-d1f2-4581-af2b-1f1dc96873d3', '8fd59087-320f-4151-8d2d-66ea616b9fa1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:47 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd" returned: 0 in 0.586s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fb75cd7d-f431-4b5a-89c6-5408dbb4c234_e8jee3esdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:21:47 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:47 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:47 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-3c66cb37-64e5-4910-bbb8-ee1325f79d5c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:47 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd 1G Nov 05 15:21:47 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-3c66cb37-64e5-4910-bbb8-ee1325f79d5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-quobyte-3c66cb37-64e5-4910-bbb8-ee1325f79d5c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-3c66cb37-64e5-4910-bbb8-ee1325f79d5c" acquired by "delete_volume" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[736c6a35-3126-44b4-9c43-8903a31491c2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "cinder-quobyte-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:47 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.312s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:47 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c Nov 05 15:21:47 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:47 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Deleted volume successfully. Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb80dea-b636-4936-ae1f-a09aee3aa0d9]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-4377b7aa-7a89-4cc2-aae3-29d6da211149 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-12ef7720-0dc0-434c-88b6-2ac9c182b8e5-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:47 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd 1G" returned: 0 in 0.479s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Downloaded image fb75cd7d-f431-4b5a-89c6-5408dbb4c234 ((None, [{'url': 'file:///opt/stack/data/glance/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'metadata': {}}])) to volume 971874dc-1fdf-4202-af93-bb8f351b28dd successfully. {{(pid=87126) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Temporary image fb75cd7d-f431-4b5a-89c6-5408dbb4c234 for user 27738981fed14a72b935f1d39742d14d is deleted. {{(pid=87126) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.volume.volume_utils [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Marking volume 971874dc-1fdf-4202-af93-bb8f351b28dd as bootable. {{(pid=87126) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 15:21:47 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f Nov 05 15:21:47 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Copying metadata from image fb75cd7d-f431-4b5a-89c6-5408dbb4c234 to 971874dc-1fdf-4202-af93-bb8f351b28dd. {{(pid=87126) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 15:21:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Creating volume glance metadata for volume 971874dc-1fdf-4202-af93-bb8f351b28dd backed by image fb75cd7d-f431-4b5a-89c6-5408dbb4c234 with: {'image_id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '20b5c33e82768daacf8542407b36606a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87126) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (244c277d-957a-4387-9346-592ad3ff628c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971874dc-1fdf-4202-af93-bb8f351b28dd', 'volume_size': 1, 'image_id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20b5c33e82768daacf8542407b36606a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '74d2c36e0c6b484897f1902f571d8173', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c2a1c3102a2801ce5d1160e9d6dff8888f54d48f65716dd8797b50a410688f067a06c364549a6c3f0142dc1da56a3064cb034615923ea12bb2305e44d2837ef4', 'id': 'fb75cd7d-f431-4b5a-89c6-5408dbb4c234', 'created_at': datetime.datetime(2026, 11, 5, 14, 21, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 14, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fb75cd7d-f431-4b5a-89c6-5408dbb4c234/file', 'properties': {}}, 'image_service': }' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9293cc8-eb72-4400-8665-a894a2c9b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Volume volume-971874dc-1fdf-4202-af93-bb8f351b28dd (971874dc-1fdf-4202-af93-bb8f351b28dd): created successfully Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9293cc8-eb72-4400-8665-a894a2c9b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Flow 'volume_create_manager' (5196e69a-ca54-421f-b079-e3cd8c9bbf33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-209ab9b5-5d76-40ba-b73f-a4fabce3a191 tempest-VolumeImageDependencyTests-1372331060 None] Created volume successfully. Nov 05 15:21:48 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c" returned: 0 in 0.439s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:48 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c Nov 05 15:21:48 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:48 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" returned: 0 in 0.400s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:48 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f Nov 05 15:21:48 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:48 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3c66cb37-64e5-4910-bbb8-ee1325f79d5c" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-3c66cb37-64e5-4910-bbb8-ee1325f79d5c" released by "delete_volume" :: held 0.756s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created reservations ['e687d94e-202e-433a-86be-9c871f5ce393', '4e36aa7c-041c-4c34-928f-9c6c4a58548a', 'a1c8ecd3-9f94-4819-8786-31d865c1cbef', '1c631b90-845d-412c-9e65-5faee22ca672'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:48 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:48 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:48 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-quobyte-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f" released by "delete_volume" :: held 0.772s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Created reservations ['dd8e744f-68c0-4bf7-8e37-4c9b3116b940', '593d1343-9fbe-41d4-89b7-fa0ce8509856', '3f41d0f4-3747-4744-ae15-ceecb1a70e7d', 'a1af7481-229a-4087-911e-aa064f098734'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:48 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:48 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-83be189f-a897-4434-a407-dcce0a46f520-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-83be189f-a897-4434-a407-dcce0a46f520-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-quobyte-83be189f-a897-4434-a407-dcce0a46f520" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-83be189f-a897-4434-a407-dcce0a46f520" acquired by "delete_volume" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:48 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.377s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Deleted volume successfully. Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d262c3-ba33-4ed7-9c54-8df482e7514c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1b13025a-92ac-403a-964a-89ad93978eb2 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-3c66cb37-64e5-4910-bbb8-ee1325f79d5c-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:49 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.417s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Deleted volume successfully. Nov 05 15:21:49 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 Nov 05 15:21:49 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b5c2a303-83a8-4f9f-996c-d51fe431b45e tempest-CreateVolumesFromSnapshotTest-1939185390 None] Lock "cinder-6fbcd55d-dd52-4544-9e8b-fc66dd54df9f-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Acquiring lock "cinder-971874dc-1fdf-4202-af93-bb8f351b28dd-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Lock "cinder-971874dc-1fdf-4202-af93-bb8f351b28dd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Acquiring lock "cinder-quobyte-971874dc-1fdf-4202-af93-bb8f351b28dd" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Lock "cinder-quobyte-971874dc-1fdf-4202-af93-bb8f351b28dd" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3a684-481e-43f8-9a14-ea5e096fc443]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:49 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520" returned: 0 in 0.545s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:49 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520 Nov 05 15:21:49 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:49 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd Nov 05 15:21:49 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:49 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-83be189f-a897-4434-a407-dcce0a46f520" returned: 0 in 0.339s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-83be189f-a897-4434-a407-dcce0a46f520" released by "delete_volume" :: held 0.990s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:49 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd" returned: 0 in 0.435s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:49 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd Nov 05 15:21:49 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:49 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created reservations ['2b1ac09d-240c-40a5-b38a-c85cbb1939ff', '86c2f79d-5652-47b7-99ee-0ebe2bcc38d9', '5c924f7b-e637-42c9-89fb-fb9892e747a1', '56c1097f-625b-4b4d-b7e5-2c004ca19d9e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:50 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:50 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:50 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-971874dc-1fdf-4202-af93-bb8f351b28dd" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Lock "cinder-quobyte-971874dc-1fdf-4202-af93-bb8f351b28dd" released by "delete_volume" :: held 0.791s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Created reservations ['fdf73d88-cff4-46ca-94fc-b43e900cf57f', 'a058256e-1893-439b-992b-1c154d04a3d1', '21fd793a-e07a-4811-bfc3-849349573450', '287608d6-fadd-48f0-beb7-acf30d4c8bda'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:50 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.289s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Deleted volume successfully. Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-b469f579-3ce5-4ad7-81b1-76708a1945eb tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-83be189f-a897-4434-a407-dcce0a46f520-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:50 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:50 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:50 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.304s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Deleted volume successfully. Nov 05 15:21:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8dc24f60-d0b7-4941-9b6e-5f698ff9ff0d tempest-VolumeImageDependencyTests-1372331060 None] Lock "cinder-971874dc-1fdf-4202-af93-bb8f351b28dd-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-fcd68e26-1d08-421c-a14e-e6b45d32caf2-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-fcd68e26-1d08-421c-a14e-e6b45d32caf2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-quobyte-fcd68e26-1d08-421c-a14e-e6b45d32caf2" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-fcd68e26-1d08-421c-a14e-e6b45d32caf2" acquired by "delete_volume" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a8ff6f-ce57-47c8-9a01-a48dd98890d3]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:51 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 Nov 05 15:21:51 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:51 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2" returned: 0 in 0.464s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:51 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2 Nov 05 15:21:51 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:51 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fcd68e26-1d08-421c-a14e-e6b45d32caf2" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-fcd68e26-1d08-421c-a14e-e6b45d32caf2" released by "delete_volume" :: held 0.871s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created reservations ['73841c80-aa44-493e-a290-9b01ce753b9c', 'e849aff0-dc02-47d2-903f-5e3f6f3c69a6', 'a278fefb-882a-45dd-9e33-19f4df9a3356', 'beb9b641-f591-4212-a4a3-805db32ded3b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:52 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:52 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-f413550a-e614-40be-b6f0-bcfb33fde461-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-f413550a-e614-40be-b6f0-bcfb33fde461-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "cinder-quobyte-f413550a-e614-40be-b6f0-bcfb33fde461" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-f413550a-e614-40be-b6f0-bcfb33fde461" acquired by "delete_volume" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[312778e3-54e0-4fc9-a911-9f578e5c1d51]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:52 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 Nov 05 15:21:52 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:52 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.433s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Deleted volume successfully. Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ef23c804-be9a-4136-904b-0e131e53a211 tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-fcd68e26-1d08-421c-a14e-e6b45d32caf2-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:52 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461" returned: 0 in 0.492s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:53 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461 Nov 05 15:21:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Flow 'volume_create_manager' (30139ea5-8b5c-4ab4-800e-b29cd258506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e398f91-a162-444d-9fc5-2774d0beeaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e398f91-a162-444d-9fc5-2774d0beeaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1733262501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc966e0d-ce08-4281-80e4-c6f5965adf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d92f231a6c94c0f83a378a44f838a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:53Z,use_quota=True,user_id='23320793848042bcac1329a0b89b7680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ce48d8-880b-4423-b0f9-bb70adf56195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ce48d8-880b-4423-b0f9-bb70adf56195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76af56f3-c14d-456c-9a5b-7e06ebbb13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76af56f3-c14d-456c-9a5b-7e06ebbb13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc966e0d-ce08-4281-80e4-c6f5965adf49', 'volume_name': 'volume-dc966e0d-ce08-4281-80e4-c6f5965adf49', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c8bdd0-dba1-49cb-8a59-3ad1f58ec740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c8bdd0-dba1-49cb-8a59-3ad1f58ec740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ce7239-0749-41aa-9c42-a555bd25495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:53 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Volume dc966e0d-ce08-4281-80e4-c6f5965adf49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc966e0d-ce08-4281-80e4-c6f5965adf49', 'volume_size': 1} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1733262501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc966e0d-ce08-4281-80e4-c6f5965adf49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d92f231a6c94c0f83a378a44f838a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:53Z,use_quota=True,user_id='23320793848042bcac1329a0b89b7680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Creating volume dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:53 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:53 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 1073741824 Nov 05 15:21:53 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:53 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f413550a-e614-40be-b6f0-bcfb33fde461" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-quobyte-f413550a-e614-40be-b6f0-bcfb33fde461" released by "delete_volume" :: held 0.974s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Created reservations ['30cd7ce9-40ae-4a89-99a6-5b1118761909', '63c20233-1c91-4d9c-9375-45087352a05e', 'e89fb575-fb44-4eba-a110-9daa443f67d2', 'e9fa694a-c25f-48b7-aca1-3419aba6dfd2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:53 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:21:53 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:53 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 1073741824" returned: 0 in 0.603s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:53 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:53 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:53 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:21:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Deleted volume successfully. Nov 05 15:21:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a1e5b482-f53e-41d3-b295-5d4f9c04ec4d tempest-CreateVolumesFromSourceVolumeTest-1807332895 None] Lock "cinder-f413550a-e614-40be-b6f0-bcfb33fde461-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:21:54 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ce7239-0749-41aa-9c42-a555bd25495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc966e0d-ce08-4281-80e4-c6f5965adf49', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5fd04d-09ca-4f95-b31a-6ef62815b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Volume volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 (dc966e0d-ce08-4281-80e4-c6f5965adf49): created successfully Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5fd04d-09ca-4f95-b31a-6ef62815b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Flow 'volume_create_manager' (30139ea5-8b5c-4ab4-800e-b29cd258506a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7a99b63f-3d1e-45d7-8eb0-6cf03ef47f9f tempest-VolumeDependencyTests-610202467 None] Created volume successfully. Nov 05 15:21:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:55 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Creating offline snapshot 39e182da-bd8c-408e-a32c-399421b7ef87 of volume dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:21:55 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e70d8-c110-4204-9ee6-87081f6a4c98]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:55 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 Nov 05 15:21:55 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:56 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (3ac0f1a5-9088-4ca8-8a6c-e2ef2fb913f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be178fa-ded7-42e6-9f53-5b90a1090387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49" returned: 0 in 0.591s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be178fa-ded7-42e6-9f53-5b90a1090387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623518712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446930a-9d27-4dbf-85bf-05b4db0abcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:56Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:56 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 1G Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534407f-4062-43f7-9fb2-cf5ef2d22545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:56 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9534407f-4062-43f7-9fb2-cf5ef2d22545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a991b99-6f14-45cb-be4c-b9cd591537cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a991b99-6f14-45cb-be4c-b9cd591537cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2446930a-9d27-4dbf-85bf-05b4db0abcf1', 'volume_name': 'volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5ff96f-3ef6-495a-8957-08e07ce8f913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c5ff96f-3ef6-495a-8957-08e07ce8f913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066eed82-c9bb-4c16-a42c-af41636a8a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Volume 2446930a-9d27-4dbf-85bf-05b4db0abcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1', 'volume_size': 1} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:56 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 1G" returned: 0 in 0.556s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:56 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 Nov 05 15:21:56 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:57 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87" returned: 0 in 0.369s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:57 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 is being set with open permissions: ugo+rw Nov 05 15:21:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:57 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 Nov 05 15:21:57 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:57 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:57 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info Nov 05 15:21:57 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:57 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:57 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info is being set with open permissions: ugo+rw Nov 05 15:21:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:57 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info Nov 05 15:21:57 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:58 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.info" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.799s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-623518712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446930a-9d27-4dbf-85bf-05b4db0abcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:21:56Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Creating volume 2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:21:58 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:58 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 1073741824 Nov 05 15:21:58 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f62c2d13-21ec-457d-9878-bd26843a380a tempest-VolumeDependencyTests-610202467 None] Create snapshot completed successfully Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-08d6af81-437e-4130-a0ce-7082d45c26cd tempest-ProjectAdminTests-1497880051 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4655227661133, 'free_capacity_gb': 1773.4655227661133, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87126) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 15:21:58 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 1073741824" returned: 0 in 0.529s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:21:58 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 Nov 05 15:21:58 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:21:59 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1" returned: 0 in 0.287s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066eed82-c9bb-4c16-a42c-af41636a8a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410b5b88-dd49-4a83-87a6-470c4934af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:59 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Volume volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 (2446930a-9d27-4dbf-85bf-05b4db0abcf1): created successfully Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410b5b88-dd49-4a83-87a6-470c4934af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (3ac0f1a5-9088-4ca8-8a6c-e2ef2fb913f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:59 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8a0bb54e-e31a-416c-a0d4-721968b94980 tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Flow 'volume_create_manager' (93c18bd5-d0b6-41fe-9d94-ad054fd6464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c35698-07c5-4a14-981e-2ee297d42793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c35698-07c5-4a14-981e-2ee297d42793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1388440302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73a7c941-f6d7-4696-b116-09f451634143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d92f231a6c94c0f83a378a44f838a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39e182da-bd8c-408e-a32c-399421b7ef87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:00Z,use_quota=True,user_id='23320793848042bcac1329a0b89b7680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57ec7f9-80f0-4703-a6c9-97b437a63c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57ec7f9-80f0-4703-a6c9-97b437a63c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0510afbb-720a-44c4-806d-c356c0c4c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0510afbb-720a-44c4-806d-c356c0c4c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73a7c941-f6d7-4696-b116-09f451634143', 'volume_name': 'volume-73a7c941-f6d7-4696-b116-09f451634143', 'volume_size': 1, 'snapshot_id': '39e182da-bd8c-408e-a32c-399421b7ef87'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de4af79-c3b7-43d9-bbe8-8cc2e6e5c1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de4af79-c3b7-43d9-bbe8-8cc2e6e5c1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3980a9c1-b73b-4e54-aa74-e9f75049ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:21:59 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Volume 73a7c941-f6d7-4696-b116-09f451634143: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73a7c941-f6d7-4696-b116-09f451634143', 'volume_size': 1, 'snapshot_id': '39e182da-bd8c-408e-a32c-399421b7ef87'} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 93359d5e-7b06-4248-aafd-f20df3e987ec of volume 2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fc3054-ff48-44b4-b23b-42cdc0cdd21b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:21:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:00 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 Nov 05 15:22:00 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:00 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:00 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec 1G Nov 05 15:22:00 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:00 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec 1G" returned: 0 in 0.487s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:00 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec Nov 05 15:22:00 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:01 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec" returned: 0 in 0.313s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:01 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec is being set with open permissions: ugo+rw Nov 05 15:22:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:01 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec Nov 05 15:22:01 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:01 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:01 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info Nov 05 15:22:01 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:01 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:01 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info is being set with open permissions: ugo+rw Nov 05 15:22:01 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:01 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info Nov 05 15:22:01 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:02 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.info" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.167s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-quobyte-39e182da-bd8c-408e-a32c-399421b7ef87-73a7c941-f6d7-4696-b116-09f451634143" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-39e182da-bd8c-408e-a32c-399421b7ef87-73a7c941-f6d7-4696-b116-09f451634143" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Creating volume 73a7c941-f6d7-4696-b116-09f451634143 from snapshot 39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-quobyte-73a7c941-f6d7-4696-b116-09f451634143" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-73a7c941-f6d7-4696-b116-09f451634143" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] snapshot: 39e182da-bd8c-408e-a32c-399421b7ef87, volume: 73a7c941-f6d7-4696-b116-09f451634143, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:22:02 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a39036cd-c4f9-49d9-8316-6b0d3735105f tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37ee2a-baee-4368-91a2-a9d828016b08]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:02 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 Nov 05 15:22:02 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:02 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc966e0d-ce08-4281-80e4-c6f5965adf49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1d5de5-0d11-4eed-9619-071b16b9a232]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:02 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:02 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 Nov 05 15:22:02 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-93359d5e-7b06-4248-aafd-f20df3e987ec-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:03 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Lock "cinder-93359d5e-7b06-4248-aafd-f20df3e987ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-2446930a-9d27-4dbf-85bf-05b4db0abcf1" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-2446930a-9d27-4dbf-85bf-05b4db0abcf1" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-93359d5e-7b06-4248-aafd-f20df3e987ec" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:03 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 Nov 05 15:22:03 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-93359d5e-7b06-4248-aafd-f20df3e987ec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 93359d5e-7b06-4248-aafd-f20df3e987ec of volume 2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2aa27-8236-4583-b56c-9ac1bbe4108e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:03 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec Nov 05 15:22:03 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:03 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec" returned: 0 in 0.472s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8e3b18-f92a-4f75-9e24-df066fa43f8a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:03 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:04 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 Nov 05 15:22:04 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:04 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1" returned: 0 in 0.920s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:04 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec Nov 05 15:22:04 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:05 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec" returned: 0 in 0.796s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:05 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec Nov 05 15:22:05 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:06 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1.93359d5e-7b06-4248-aafd-f20df3e987ec" returned: 0 in 0.488s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=200,cinder:UPDATE=246,cinder:INSERT=72,cinder:DELETE=26 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=181,cinder:UPDATE=269,cinder:INSERT=66,cinder:DELETE=22 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-93359d5e-7b06-4248-aafd-f20df3e987ec" released by "_delete_snapshot" :: held 2.913s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-2446930a-9d27-4dbf-85bf-05b4db0abcf1" released by "delete_snapshot" :: held 2.949s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Created reservations ['3700302d-5647-4f0d-be9f-7e6df73ac1c7', 'd3becf9e-1e31-4b9a-a0c3-4fc9c3c3e6bb', 'd163e0cc-bfe7-4b25-be3c-fcab59f28e34', '82a835de-3c5a-46e9-a9f1-c61a355657f5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-8643361e-1018-4b8c-8e4f-a644a2b57c17 tempest-ProjectMemberTests-440827557 None] Lock "cinder-93359d5e-7b06-4248-aafd-f20df3e987ec-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-2446930a-9d27-4dbf-85bf-05b4db0abcf1-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Lock "cinder-2446930a-9d27-4dbf-85bf-05b4db0abcf1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-2446930a-9d27-4dbf-85bf-05b4db0abcf1" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-2446930a-9d27-4dbf-85bf-05b4db0abcf1" acquired by "delete_volume" :: waited 0.049s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec07b224-18e0-4407-972f-9bd9d43fad71]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:07 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 Nov 05 15:22:07 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:07 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1" returned: 0 in 0.902s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:07 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1 Nov 05 15:22:07 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:08 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2446930a-9d27-4dbf-85bf-05b4db0abcf1" returned: 0 in 0.766s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-2446930a-9d27-4dbf-85bf-05b4db0abcf1" released by "delete_volume" :: held 1.821s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Created reservations ['2bcdaaeb-d5a5-4abd-9f06-a30c55ac07b9', '00d59671-e39d-48bf-9c70-78b161c56878', '37a298d7-1c8e-4f55-8534-4cba66b5dd61', '5f949445-3594-4fcd-bc94-ec333201bea8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:08 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:08 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:09 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:22:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6a243185-45f3-42f5-a0c4-71951c74f0fc tempest-ProjectMemberTests-440827557 None] Lock "cinder-2446930a-9d27-4dbf-85bf-05b4db0abcf1-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (47c18656-9509-4ba0-a663-e25cb7830d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fcf773-a6bd-4847-a13a-2bce7141da7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6fcf773-a6bd-4847-a13a-2bce7141da7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40322039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feaac8ab-351f-40dd-891e-9e8f9bd3aeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:10Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc03d20-2404-4c51-9e4c-b6b88b42c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc03d20-2404-4c51-9e4c-b6b88b42c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73fd287-ee56-48be-b5e3-87eed1c18fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73fd287-ee56-48be-b5e3-87eed1c18fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feaac8ab-351f-40dd-891e-9e8f9bd3aeb7', 'volume_name': 'volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d41cb45-e1bd-4c6c-8b6e-82111059e583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d41cb45-e1bd-4c6c-8b6e-82111059e583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363178b0-6439-4940-ad5c-8c5a9f418632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:10 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Volume feaac8ab-351f-40dd-891e-9e8f9bd3aeb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7', 'volume_size': 1} Nov 05 15:22:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (6f11494b-5cdd-4f5e-927b-e34463d35595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c3956f-7f15-4294-aff1-3642a6717be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c3956f-7f15-4294-aff1-3642a6717be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-374048020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e1d21-61f7-4190-8795-0fe3b57f3d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:11Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f232426-93d7-4b70-bae8-7f4e93a8af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f232426-93d7-4b70-bae8-7f4e93a8af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad44301e-8319-46ae-b78b-12d65cc181d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad44301e-8319-46ae-b78b-12d65cc181d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9e1d21-61f7-4190-8795-0fe3b57f3d67', 'volume_name': 'volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6df0c7-6c32-45d6-a882-57607a403f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6df0c7-6c32-45d6-a882-57607a403f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f61d830-f747-49a3-b566-3b0558f6dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Volume 5d9e1d21-61f7-4190-8795-0fe3b57f3d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67', 'volume_size': 1} Nov 05 15:22:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:12 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143" returned: 0 in 8.917s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49, size 1024.00 MB, duration 8.92 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:22:12 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Converted 1024.00 MB image at 114.83 MB/s Nov 05 15:22:12 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 is being set with open permissions: ugo+rw Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:12 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 Nov 05 15:22:12 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:12 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-73a7c941-f6d7-4696-b116-09f451634143" released by "_copy_volume_from_snapshot" :: held 10.118s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-39e182da-bd8c-408e-a32c-399421b7ef87-73a7c941-f6d7-4696-b116-09f451634143" released by "_create_volume_from_snapshot" :: held 10.199s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.231s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.870s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-40322039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feaac8ab-351f-40dd-891e-9e8f9bd3aeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:10Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Creating volume feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:12 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:12 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 1073741824 Nov 05 15:22:12 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3980a9c1-b73b-4e54-aa74-e9f75049ae15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73a7c941-f6d7-4696-b116-09f451634143', 'volume_size': 1, 'snapshot_id': '39e182da-bd8c-408e-a32c-399421b7ef87'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70c378f-623c-4e45-8573-01f17b4dbfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Volume volume-73a7c941-f6d7-4696-b116-09f451634143 (73a7c941-f6d7-4696-b116-09f451634143): created successfully Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c70c378f-623c-4e45-8573-01f17b4dbfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Flow 'volume_create_manager' (93c18bd5-d0b6-41fe-9d94-ad054fd6464c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dd669676-93ad-4738-846f-df78a7ac1b36 tempest-VolumeDependencyTests-610202467 None] Created volume successfully. Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-39e182da-bd8c-408e-a32c-399421b7ef87-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-39e182da-bd8c-408e-a32c-399421b7ef87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-quobyte-dc966e0d-ce08-4281-80e4-c6f5965adf49" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-dc966e0d-ce08-4281-80e4-c6f5965adf49" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-quobyte-39e182da-bd8c-408e-a32c-399421b7ef87" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-39e182da-bd8c-408e-a32c-399421b7ef87" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Deleting offline snapshot 39e182da-bd8c-408e-a32c-399421b7ef87 of volume dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] snapshot_file for this snap is: volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[504ed79a-2b14-4e3c-9aee-6359236644bc]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:12 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 1073741824" returned: 0 in 0.538s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:12 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 Nov 05 15:22:12 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:13 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 Nov 05 15:22:13 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:13 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" returned: 0 in 0.268s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.546s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-374048020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9e1d21-61f7-4190-8795-0fe3b57f3d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:11Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Creating volume 5d9e1d21-61f7-4190-8795-0fe3b57f3d67 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:13 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:13 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc966e0d-ce08-4281-80e4-c6f5965adf49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:13 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 1073741824 Nov 05 15:22:13 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363178b0-6439-4940-ad5c-8c5a9f418632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bae27f-8623-45b0-ace6-c8aa34afa457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f104b377-7866-4920-ac96-754054d9abf7]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:13 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Volume volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 (feaac8ab-351f-40dd-891e-9e8f9bd3aeb7): created successfully Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bae27f-8623-45b0-ace6-c8aa34afa457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (47c18656-9509-4ba0-a663-e25cb7830d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3a8ad31d-298a-4a61-ab4d-1fbadeffce1d tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:22:13 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 Nov 05 15:22:13 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:13 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 1073741824" returned: 0 in 0.543s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:13 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 Nov 05 15:22:13 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:13 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49" returned: 0 in 0.622s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:13 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 Nov 05 15:22:13 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:14 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67" returned: 0 in 0.275s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f61d830-f747-49a3-b566-3b0558f6dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4af16f-13fb-4e88-b17a-a57f74b1314f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:14 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Volume volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 (5d9e1d21-61f7-4190-8795-0fe3b57f3d67): created successfully Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4af16f-13fb-4e88-b17a-a57f74b1314f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (6f11494b-5cdd-4f5e-927b-e34463d35595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:14 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f0ca07a4-420a-43d4-9d04-d7bc656f855b tempest-ProjectReaderTests-1937165927 None] Created volume successfully. Nov 05 15:22:14 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87" returned: 0 in 0.416s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:14 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87 Nov 05 15:22:14 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 536a1096-43ba-4dd1-a139-ed78d92d04a7 of volume feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aa3267-f98f-47a2-896a-6fc041a2303b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:14 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49.39e182da-bd8c-408e-a32c-399421b7ef87" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:14 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 Nov 05 15:22:14 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-39e182da-bd8c-408e-a32c-399421b7ef87" released by "_delete_snapshot" :: held 1.943s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-dc966e0d-ce08-4281-80e4-c6f5965adf49" released by "delete_snapshot" :: held 1.975s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Created reservations ['d15d6fb5-86d0-4819-9b3b-f0ac0836f605', '7c85b8c0-ba7a-48e3-94f8-07c7c6d75a63', 'fb3a711b-0dfc-4111-8590-1fd0823b386a', '9bb8c8d2-fcf1-48bb-9d99-6717749d1f0c'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-5d9e1d21-61f7-4190-8795-0fe3b57f3d67-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-5d9e1d21-61f7-4190-8795-0fe3b57f3d67-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-quobyte-5d9e1d21-61f7-4190-8795-0fe3b57f3d67" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Delete snapshot completed successfully. Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0f057dc7-f247-46ca-ba6e-f5c6e53cafc7 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-39e182da-bd8c-408e-a32c-399421b7ef87-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-5d9e1d21-61f7-4190-8795-0fe3b57f3d67" acquired by "delete_volume" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-dc966e0d-ce08-4281-80e4-c6f5965adf49-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:15 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[0388b389-ce91-4857-b6ca-67624a3830f0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:15 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 1G Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-dc966e0d-ce08-4281-80e4-c6f5965adf49-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:15 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-quobyte-dc966e0d-ce08-4281-80e4-c6f5965adf49" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-dc966e0d-ce08-4281-80e4-c6f5965adf49" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:15 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 Nov 05 15:22:15 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bb2ecc-894f-49eb-a374-f88294be19ba]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 Nov 05 15:22:15 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 1G" returned: 0 in 0.500s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67" returned: 0 in 0.460s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 Nov 05 15:22:15 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67 Nov 05 15:22:15 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49" returned: 0 in 0.427s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49 Nov 05 15:22:15 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-5d9e1d21-61f7-4190-8795-0fe3b57f3d67" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:15 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7" returned: 0 in 0.299s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 is being set with open permissions: ugo+rw Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-5d9e1d21-61f7-4190-8795-0fe3b57f3d67" released by "delete_volume" :: held 0.867s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:15 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 Nov 05 15:22:15 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:15 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Created reservations ['e47e9ea8-f792-4957-b58f-b0e4f03fa4ca', '29ed7274-56da-44df-9e00-494f3eed7fe2', 'c86122d6-91cd-4a79-b0f2-f00f07909d55', '6e4bab9e-8aa4-4c3e-8942-a5200ebe03c1'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:16 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-dc966e0d-ce08-4281-80e4-c6f5965adf49" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-dc966e0d-ce08-4281-80e4-c6f5965adf49" released by "delete_volume" :: held 0.802s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:16 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:16 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Created reservations ['7e7ac846-61c3-4245-bfe3-76cbda18fc0d', '1e1fb968-726f-468c-b623-c9b75cb36b17', '32ffb465-5218-4146-9cb3-65f983c26153', 'f982320c-d0bf-4765-bb71-eb6941c1d426'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:16 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7" returned: 0 in 0.358s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:16 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info Nov 05 15:22:16 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:16 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:16 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:16 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Deleted volume successfully. Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-974443b9-b6b8-495f-8604-acf7d1e9cbc7 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-5d9e1d21-61f7-4190-8795-0fe3b57f3d67-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:16 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info" returned: 0 in 0.368s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:16 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info is being set with open permissions: ugo+rw Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:16 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info Nov 05 15:22:16 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:16 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Deleted volume successfully. Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd313fa6-ce41-4341-94ce-4fce16cfbc38 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-dc966e0d-ce08-4281-80e4-c6f5965adf49-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (5ee4c6d9-c823-49e1-a7ed-187716dde464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20286721-3e2f-484c-bb6d-fdbbfd19e24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20286721-3e2f-484c-bb6d-fdbbfd19e24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522639156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f61ebf-f917-44ae-b439-97b61506a7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:17Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c150a29-1924-44ed-a6d9-8ba413a47de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c150a29-1924-44ed-a6d9-8ba413a47de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cddd54-f57f-4597-88e5-2362a74014e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cddd54-f57f-4597-88e5-2362a74014e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f61ebf-f917-44ae-b439-97b61506a7a0', 'volume_name': 'volume-12f61ebf-f917-44ae-b439-97b61506a7a0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06022732-b85c-4f49-83d6-5697b17d40ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06022732-b85c-4f49-83d6-5697b17d40ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404e66fb-b521-4a17-866a-c6ae198d0cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Volume 12f61ebf-f917-44ae-b439-97b61506a7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f61ebf-f917-44ae-b439-97b61506a7a0', 'volume_size': 1} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:16 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.info" returned: 0 in 0.297s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522639156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f61ebf-f917-44ae-b439-97b61506a7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:17Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Creating volume 12f61ebf-f917-44ae-b439-97b61506a7a0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:17 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:17 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 1073741824 Nov 05 15:22:17 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e9807d83-fba3-436b-ad22-e022ab868209 tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-73a7c941-f6d7-4696-b116-09f451634143-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-73a7c941-f6d7-4696-b116-09f451634143-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "cinder-quobyte-73a7c941-f6d7-4696-b116-09f451634143" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-73a7c941-f6d7-4696-b116-09f451634143" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd12bed-2c2d-4f9b-ab38-41dc411f8d0f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:17 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 1073741824" returned: 0 in 0.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:17 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 Nov 05 15:22:17 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:17 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 Nov 05 15:22:17 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-536a1096-43ba-4dd1-a139-ed78d92d04a7-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Lock "cinder-536a1096-43ba-4dd1-a139-ed78d92d04a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-536a1096-43ba-4dd1-a139-ed78d92d04a7" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-536a1096-43ba-4dd1-a139-ed78d92d04a7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 536a1096-43ba-4dd1-a139-ed78d92d04a7 of volume feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:17 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0" returned: 0 in 0.277s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a3556e-ab31-422f-b0d7-4f1fee4c15ef]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404e66fb-b521-4a17-866a-c6ae198d0cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f61ebf-f917-44ae-b439-97b61506a7a0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ba9b2c-e22f-4654-b6a1-c2d3c79a18d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:17 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Volume volume-12f61ebf-f917-44ae-b439-97b61506a7a0 (12f61ebf-f917-44ae-b439-97b61506a7a0): created successfully Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ba9b2c-e22f-4654-b6a1-c2d3c79a18d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (5ee4c6d9-c823-49e1-a7ed-187716dde464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:17 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143" returned: 0 in 0.414s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:17 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-92e3b7a9-4445-48fe-8eeb-e5e190e96d5c tempest-ProjectReaderTests-1937165927 None] Created volume successfully. Nov 05 15:22:17 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143 Nov 05 15:22:17 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:17 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 Nov 05 15:22:17 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:18 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-73a7c941-f6d7-4696-b116-09f451634143" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-quobyte-73a7c941-f6d7-4696-b116-09f451634143" released by "delete_volume" :: held 0.724s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:18 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Created reservations ['fcd6fece-069b-4e1c-b8df-44fda6b47e48', '0a529fcf-949a-4c3e-aa43-532f137f80d0', 'fa0ec992-0d2d-43ee-8f69-5edd78f50f42', '1f73fbbf-1f6d-4e6b-b2ca-3ada6fe185ba'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ca75cb-38aa-40ab-bc3f-a9d110b9ec35]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:18 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:18 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 Nov 05 15:22:18 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:18 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:18 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Deleted volume successfully. Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-9bedbd55-3152-4a1e-acc9-7eef86312483 tempest-VolumeDependencyTests-610202467 None] Lock "cinder-73a7c941-f6d7-4696-b116-09f451634143-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:18 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" returned: 0 in 0.421s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:18 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 Nov 05 15:22:18 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-12f61ebf-f917-44ae-b439-97b61506a7a0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-12f61ebf-f917-44ae-b439-97b61506a7a0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-quobyte-12f61ebf-f917-44ae-b439-97b61506a7a0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-12f61ebf-f917-44ae-b439-97b61506a7a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d930dedb-de25-4281-8216-9869ac574769]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:19 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7" returned: 0 in 0.507s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:19 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7 Nov 05 15:22:19 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:19 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 Nov 05 15:22:19 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:19 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7.536a1096-43ba-4dd1-a139-ed78d92d04a7" returned: 0 in 0.322s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-536a1096-43ba-4dd1-a139-ed78d92d04a7" released by "_delete_snapshot" :: held 1.804s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" released by "delete_snapshot" :: held 1.839s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:19 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0" returned: 0 in 0.513s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Created reservations ['7b54d116-864a-4760-9bcb-62536c8fe9cb', '9e7ff965-4441-408a-a3f1-6c5070ea97f9', 'a5a224a3-3a7d-4e8e-87a7-28dc55019375', 'c8305435-b23c-4518-826d-3cc8d14feae4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:19 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0 Nov 05 15:22:19 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:19 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:22:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-6d642f75-c20f-4384-b0cf-cbf32d18b106 tempest-ProjectMemberTests-440827557 None] Lock "cinder-536a1096-43ba-4dd1-a139-ed78d92d04a7-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:20 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-12f61ebf-f917-44ae-b439-97b61506a7a0" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-12f61ebf-f917-44ae-b439-97b61506a7a0" released by "delete_volume" :: held 0.906s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Lock "cinder-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Created reservations ['a2a696e6-a594-46c6-882e-82adc21b69b4', 'bc92b571-581d-4ee1-be24-ce1dc6f62924', '25ea891f-3073-4995-b137-29632f3b7e9d', 'd9a45955-0711-46a7-97b4-9a8a33f32ccb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[003eb7dc-4e18-4b53-9a2e-fd8ffb883720]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:20 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 Nov 05 15:22:20 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:20 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:20 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:20 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.280s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Deleted volume successfully. Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-841d2ee3-7a94-43e5-bb7c-e78cf31f4b67 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-12f61ebf-f917-44ae-b439-97b61506a7a0-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:20 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" returned: 0 in 0.438s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:20 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7 Nov 05 15:22:20 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:20 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7" released by "delete_volume" :: held 0.794s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Created reservations ['5fb14a3a-0701-409f-8b95-6fcf4c776d3f', 'a903fb44-31fe-4e6c-b73c-0e07e350dd6b', '3b044327-00aa-43e4-9b2b-48388f7535cc', '3e42e3a7-73de-4965-8d39-bf536a0a9500'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:21 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:21 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:21 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.395s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-5b206cfd-74a3-4c9b-b6ae-f6e3856adf33 tempest-ProjectMemberTests-440827557 None] Lock "cinder-feaac8ab-351f-40dd-891e-9e8f9bd3aeb7-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (1bc5dc50-021c-43c3-9196-4a81dfd550ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e4865f-6c73-4c6e-8891-890521687ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05e4865f-6c73-4c6e-8891-890521687ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234580947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f762fe-6019-4e09-8806-f3d27b2d572f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:22Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee867378-1098-4c5f-b99b-2ca4070d8bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee867378-1098-4c5f-b99b-2ca4070d8bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e46245-6e4a-4bea-9ced-bdcc989457bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e46245-6e4a-4bea-9ced-bdcc989457bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f762fe-6019-4e09-8806-f3d27b2d572f', 'volume_name': 'volume-50f762fe-6019-4e09-8806-f3d27b2d572f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d7fb7-b3f4-4cd4-ad50-954b0491d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977d7fb7-b3f4-4cd4-ad50-954b0491d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2124eb44-05c5-43be-bfaa-9cbb49dee709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Volume 50f762fe-6019-4e09-8806-f3d27b2d572f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f762fe-6019-4e09-8806-f3d27b2d572f', 'volume_size': 1} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234580947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f762fe-6019-4e09-8806-f3d27b2d572f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:22Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Creating volume 50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:21 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:22 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f 1073741824 Nov 05 15:22:22 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (59982a04-6ef3-4d89-aab4-2c4dc82a5a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9d394c-4566-45c2-b018-02fb4de8f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9d394c-4566-45c2-b018-02fb4de8f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863414139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee18b32d-40ef-4cde-8055-c3a1fefed00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:22Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2b4ecb-4397-41e1-97f6-d405e095f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2b4ecb-4397-41e1-97f6-d405e095f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6451394-be37-490a-af8a-6b2a4e8f60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6451394-be37-490a-af8a-6b2a4e8f60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee18b32d-40ef-4cde-8055-c3a1fefed00a', 'volume_name': 'volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85cea25-c969-4247-a5e1-ffa924afb66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85cea25-c969-4247-a5e1-ffa924afb66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a39d6a-821a-4f50-a0d2-ca947065640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Volume ee18b32d-40ef-4cde-8055-c3a1fefed00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a', 'volume_size': 1} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:22 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f 1073741824" returned: 0 in 0.573s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:22 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f Nov 05 15:22:22 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:22 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f" returned: 0 in 0.296s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1863414139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee18b32d-40ef-4cde-8055-c3a1fefed00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:22Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Creating volume ee18b32d-40ef-4cde-8055-c3a1fefed00a {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:22 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:22 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a 1073741824 Nov 05 15:22:22 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2124eb44-05c5-43be-bfaa-9cbb49dee709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f762fe-6019-4e09-8806-f3d27b2d572f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acda0b4b-373e-4158-9191-48c256f2285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:22 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Volume volume-50f762fe-6019-4e09-8806-f3d27b2d572f (50f762fe-6019-4e09-8806-f3d27b2d572f): created successfully Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acda0b4b-373e-4158-9191-48c256f2285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:22 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (1bc5dc50-021c-43c3-9196-4a81dfd550ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ac07e7c5-6e54-4757-aa37-a49936233555 tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:22:23 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a 1073741824" returned: 0 in 0.522s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:23 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a Nov 05 15:22:23 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:23 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a39d6a-821a-4f50-a0d2-ca947065640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90ae4fe-8291-4abb-b0e8-7b2bfc8fb934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:23 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Volume volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a (ee18b32d-40ef-4cde-8055-c3a1fefed00a): created successfully Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90ae4fe-8291-4abb-b0e8-7b2bfc8fb934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:23 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (59982a04-6ef3-4d89-aab4-2c4dc82a5a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:23 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-b0c9d49e-6d14-471e-9948-e7c0325ee7af tempest-ProjectReaderTests-1937165927 None] Created volume successfully. Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Creating offline snapshot e7b98a2c-17ee-4fad-a2f6-465a1b793745 of volume 50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeebc18-96d6-432e-a448-3456e30376cc]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-ee18b32d-40ef-4cde-8055-c3a1fefed00a-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-ee18b32d-40ef-4cde-8055-c3a1fefed00a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:24 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f Nov 05 15:22:24 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-quobyte-ee18b32d-40ef-4cde-8055-c3a1fefed00a" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-ee18b32d-40ef-4cde-8055-c3a1fefed00a" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b187eec1-a68b-487a-ac32-17f9a893c491]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:24 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a Nov 05 15:22:24 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:24 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f" returned: 0 in 0.475s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:24 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 1G Nov 05 15:22:24 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:24 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a" returned: 0 in 0.436s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:24 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a Nov 05 15:22:24 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:25 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-ee18b32d-40ef-4cde-8055-c3a1fefed00a" returned: 0 in 0.303s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-ee18b32d-40ef-4cde-8055-c3a1fefed00a" released by "delete_volume" :: held 0.815s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Created reservations ['1d52578d-e682-4df9-bf01-a2588645271f', 'd54c359a-2cc8-4ec8-8df9-92943a128b13', '41b5e9b5-414e-4595-a126-b3af42bc23b7', '5721a98a-9686-462a-80b0-940eee2d4dbc'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:25 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 1G" returned: 0 in 0.623s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f762fe-6019-4e09-8806-f3d27b2d572f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:25 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f762fe-6019-4e09-8806-f3d27b2d572f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 Nov 05 15:22:25 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:25 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:25 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:25 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:25 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Deleted volume successfully. Nov 05 15:22:25 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50f762fe-6019-4e09-8806-f3d27b2d572f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745" returned: 0 in 0.525s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:25 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 is being set with open permissions: ugo+rw Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1307b550-314c-4de3-a308-81693e5eb425 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-ee18b32d-40ef-4cde-8055-c3a1fefed00a-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:25 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 Nov 05 15:22:25 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:26 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745" returned: 0 in 0.403s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (226fa899-eeb2-448b-a5df-6e3f3f8b7275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2047c5ed-cd57-4368-8915-0c30d92e294e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2047c5ed-cd57-4368-8915-0c30d92e294e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933915250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2998e34b-d0d1-4e22-90a8-14ecfb95bd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:26Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7575e6-58e3-4fc4-a804-dfd1f0da095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7575e6-58e3-4fc4-a804-dfd1f0da095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:26 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info Nov 05 15:22:26 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ef4f5a-7217-44a9-9a02-d96e6e8dbcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ef4f5a-7217-44a9-9a02-d96e6e8dbcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2998e34b-d0d1-4e22-90a8-14ecfb95bd1c', 'volume_name': 'volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d111cd5-ca49-4739-b413-837a435802e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d111cd5-ca49-4739-b413-837a435802e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea56640-4fc9-43e7-8953-3fcb41fddb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:26 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Volume 2998e34b-d0d1-4e22-90a8-14ecfb95bd1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c', 'volume_size': 1} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:26 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:26 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info is being set with open permissions: ugo+rw Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:26 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info Nov 05 15:22:26 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:26 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.info" returned: 0 in 0.270s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.794s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.562s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-933915250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2998e34b-d0d1-4e22-90a8-14ecfb95bd1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b90b949ea204ec3b6cafc8bc3fc739e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:26Z,use_quota=True,user_id='0f6a8344905947178c3ad076d1516204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Creating volume 2998e34b-d0d1-4e22-90a8-14ecfb95bd1c {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:26 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:26 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c 1073741824 Nov 05 15:22:26 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-5b6f61c8-73b6-4fbe-9e46-4f4271337a3f tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-e7b98a2c-17ee-4fad-a2f6-465a1b793745-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Lock "cinder-e7b98a2c-17ee-4fad-a2f6-465a1b793745-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-50f762fe-6019-4e09-8806-f3d27b2d572f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-50f762fe-6019-4e09-8806-f3d27b2d572f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-e7b98a2c-17ee-4fad-a2f6-465a1b793745" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-e7b98a2c-17ee-4fad-a2f6-465a1b793745" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot e7b98a2c-17ee-4fad-a2f6-465a1b793745 of volume 50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dc5c90-963c-4f28-9f6d-a5353e3e230b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:27 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c 1073741824" returned: 0 in 0.641s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:27 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 Nov 05 15:22:27 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:27 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c Nov 05 15:22:27 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:27 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c" returned: 0 in 0.321s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:27 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea56640-4fc9-43e7-8953-3fcb41fddb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cc1ced-40c1-4b82-b6a2-3a398d105c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745" returned: 0 in 0.480s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50f762fe-6019-4e09-8806-f3d27b2d572f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:27 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Volume volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c (2998e34b-d0d1-4e22-90a8-14ecfb95bd1c): created successfully Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cc1ced-40c1-4b82-b6a2-3a398d105c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Flow 'volume_create_manager' (226fa899-eeb2-448b-a5df-6e3f3f8b7275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a3582b-72d4-48d9-a6ff-0a2d708ac33a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:27 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-3c0e55e8-f24c-4212-af60-7a58a78f2234 tempest-ProjectReaderTests-1937165927 None] Created volume successfully. Nov 05 15:22:28 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f Nov 05 15:22:28 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "cinder-quobyte-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab6f2e9-4ffd-4337-984e-6582073122ae]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:28 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f" returned: 0 in 0.533s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:28 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 Nov 05 15:22:28 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:28 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c Nov 05 15:22:28 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:28 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745" returned: 0 in 0.411s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:28 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745 Nov 05 15:22:28 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:28 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c" returned: 0 in 0.516s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:29 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c Nov 05 15:22:29 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:29 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f.e7b98a2c-17ee-4fad-a2f6-465a1b793745" returned: 0 in 0.337s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-e7b98a2c-17ee-4fad-a2f6-465a1b793745" released by "_delete_snapshot" :: held 1.962s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-50f762fe-6019-4e09-8806-f3d27b2d572f" released by "delete_snapshot" :: held 2.001s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:29 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c" returned: 0 in 0.380s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-quobyte-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c" released by "delete_volume" :: held 0.970s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Created reservations ['3276b2f3-6d78-4859-bda7-08450e6a9b6d', '29968d4e-9f5f-4bfc-a209-d443e1c59ce4', '430ef665-81d1-4681-bb91-55d48bab93f5', '4a95fbfd-f3ab-42b5-a389-86cb81cf837f'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Created reservations ['87940c04-8368-4518-903b-8d6a79076e3b', '8beee4c7-e4f1-4e01-86d9-3d2bfec29587', '24cdfd70-3ac4-45d1-8a2a-c08f398859d8', 'e32230b1-99dd-49ce-be31-3b36a8a5fb31'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (4b792116-3b1d-4a53-8d4f-87cb01c1916d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4eac20-135e-4104-9047-a58259353981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4eac20-135e-4104-9047-a58259353981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278355345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87b60b6-2086-4a1f-b1ea-609c5255c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:29Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce09688-4564-40eb-ae36-5908a7c7e404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce09688-4564-40eb-ae36-5908a7c7e404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231add05-006a-4e0e-9134-b81bc190018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231add05-006a-4e0e-9134-b81bc190018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87b60b6-2086-4a1f-b1ea-609c5255c1f0', 'volume_name': 'volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5850d18-80e4-47d3-9d28-0f6d0062cedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5850d18-80e4-47d3-9d28-0f6d0062cedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eb81e9-2a2e-454f-b04c-08885fcb4d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Volume c87b60b6-2086-4a1f-b1ea-609c5255c1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0', 'volume_size': 1} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278355345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87b60b6-2086-4a1f-b1ea-609c5255c1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:29Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Creating volume c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-55a360c4-8996-42b7-9258-2eda2451cde2 tempest-ProjectMemberTests-440827557 None] Lock "cinder-e7b98a2c-17ee-4fad-a2f6-465a1b793745-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:29 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 1073741824 Nov 05 15:22:29 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:29 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:29 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:29 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:29 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Deleted volume successfully. Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-751135d2-332e-4c11-bba2-23cf83afb6a1 tempest-ProjectReaderTests-1937165927 None] Lock "cinder-2998e34b-d0d1-4e22-90a8-14ecfb95bd1c-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:30 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 1073741824" returned: 0 in 0.481s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:30 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 Nov 05 15:22:30 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:30 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" returned: 0 in 0.365s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8eb81e9-2a2e-454f-b04c-08885fcb4d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb209e2-743c-4353-bfbb-4c930e3b9da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-50f762fe-6019-4e09-8806-f3d27b2d572f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:30 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Volume volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 (c87b60b6-2086-4a1f-b1ea-609c5255c1f0): created successfully Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb209e2-743c-4353-bfbb-4c930e3b9da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (4b792116-3b1d-4a53-8d4f-87cb01c1916d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Lock "cinder-50f762fe-6019-4e09-8806-f3d27b2d572f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:30 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-bcdd01cb-3bc3-42ba-952a-a3ec7fc5d3e1 tempest-ProjectReaderTests-261681190 None] Created volume successfully. Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-50f762fe-6019-4e09-8806-f3d27b2d572f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-50f762fe-6019-4e09-8806-f3d27b2d572f" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd58b30-465f-4424-9809-f8c5add5008b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:30 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f Nov 05 15:22:30 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:31 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f" returned: 0 in 0.413s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:31 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f Nov 05 15:22:31 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:31 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-50f762fe-6019-4e09-8806-f3d27b2d572f" returned: 0 in 0.305s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-50f762fe-6019-4e09-8806-f3d27b2d572f" released by "delete_volume" :: held 0.841s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Created reservations ['757a4d03-21ef-47e0-ac51-840e2d330d74', '12efa6b4-2d2d-4095-a78a-bfe28c36026b', '8207520d-7fbb-40bc-b82e-8abf75281c65', '72cf6bd4-86ca-47e0-8d09-8a073b2c7b91'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:31 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:31 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Creating offline snapshot 9e919efe-8cc6-47e9-ba9b-d2d42e288f0a of volume c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:32 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[482596e6-0f3f-4162-a122-1ec1716b32fb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-64317fa5-a869-449b-a7f9-8eaa465ef5e3 tempest-ProjectMemberTests-440827557 None] Lock "cinder-50f762fe-6019-4e09-8806-f3d27b2d572f-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:32 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 Nov 05 15:22:32 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (aba82949-3a70-4730-a953-915168db2ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b679fe93-ebac-4d4f-a614-f61a2cc7728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b679fe93-ebac-4d4f-a614-f61a2cc7728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201032423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927756e9-e637-4df1-86f0-454daee15583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:32Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fbb9fd-971b-4e91-8f86-af3fb54018a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fbb9fd-971b-4e91-8f86-af3fb54018a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0776504f-346d-453e-9d05-a420fc1a3b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0776504f-346d-453e-9d05-a420fc1a3b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927756e9-e637-4df1-86f0-454daee15583', 'volume_name': 'volume-927756e9-e637-4df1-86f0-454daee15583', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a1ddc3-e6c7-4cd3-b71d-098aef624fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a1ddc3-e6c7-4cd3-b71d-098aef624fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807c534a-6eb4-443d-8266-45a2ec76d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:32 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Volume 927756e9-e637-4df1-86f0-454daee15583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927756e9-e637-4df1-86f0-454daee15583', 'volume_size': 1} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:32 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" returned: 0 in 0.558s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:32 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a 1G Nov 05 15:22:32 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:33 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a 1G" returned: 0 in 0.594s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:33 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a Nov 05 15:22:33 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:33 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" returned: 0 in 0.379s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:33 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a is being set with open permissions: ugo+rw Nov 05 15:22:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:33 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a Nov 05 15:22:33 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:33 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:33 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info Nov 05 15:22:33 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:34 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:34 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info is being set with open permissions: ugo+rw Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:34 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info Nov 05 15:22:34 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:34 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.info" returned: 0 in 0.283s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.930s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201032423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927756e9-e637-4df1-86f0-454daee15583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:32Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Creating volume 927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:34 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:34 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 1073741824 Nov 05 15:22:34 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:34 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-16c32cf2-a3cd-42b7-8e0d-c43bb18e4076 tempest-ProjectReaderTests-261681190 None] Create snapshot completed successfully Nov 05 15:22:34 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 1073741824" returned: 0 in 0.470s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:35 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 Nov 05 15:22:35 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:35 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (807c534a-6eb4-443d-8266-45a2ec76d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927756e9-e637-4df1-86f0-454daee15583', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322f4e78-7e3a-400d-95da-a96c7f8932ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:35 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Volume volume-927756e9-e637-4df1-86f0-454daee15583 (927756e9-e637-4df1-86f0-454daee15583): created successfully Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322f4e78-7e3a-400d-95da-a96c7f8932ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (aba82949-3a70-4730-a953-915168db2ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-81d27d14-e434-44fc-934c-9c140c80eb85 tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-9e919efe-8cc6-47e9-ba9b-d2d42e288f0a-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Lock "cinder-9e919efe-8cc6-47e9-ba9b-d2d42e288f0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Deleting offline snapshot 9e919efe-8cc6-47e9-ba9b-d2d42e288f0a of volume c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] snapshot_file for this snap is: volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b063caf-03f7-46a1-8281-8636eff1f5d2]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 of volume 927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:35 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a Nov 05 15:22:35 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2cb255-fe3f-49bf-81c9-13225e60a74c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:36 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 Nov 05 15:22:36 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:36 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24502c-055d-4ffc-8267-4e9f0d221338]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:36 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583" returned: 0 in 0.535s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:36 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 Nov 05 15:22:36 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:36 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 1G Nov 05 15:22:36 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:36 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" returned: 0 in 0.483s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:36 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a Nov 05 15:22:36 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:36 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 1G" returned: 0 in 0.520s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:36 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927756e9-e637-4df1-86f0-454daee15583 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:36 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927756e9-e637-4df1-86f0-454daee15583 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 Nov 05 15:22:36 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:37 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" returned: 0 in 0.539s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:37 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a Nov 05 15:22:37 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:37 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-927756e9-e637-4df1-86f0-454daee15583 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:37 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 is being set with open permissions: ugo+rw Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:37 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 Nov 05 15:22:37 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:37 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0.9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" returned: 0 in 0.301s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-9e919efe-8cc6-47e9-ba9b-d2d42e288f0a" released by "_delete_snapshot" :: held 1.983s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" released by "delete_snapshot" :: held 2.017s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:37 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" returned: 0 in 0.315s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:37 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Created reservations ['faa389d3-4182-4678-9d7b-6de95f90fe42', '3b9707b1-f031-44a6-b2be-bca093500bb1', '554e71f6-4677-415c-a948-7812ffe9d573', '9620d8d5-912a-4e4e-aa92-8570e6108fa0'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:37 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:37 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Delete snapshot completed successfully. Nov 05 15:22:37 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dfb5c3ec-cb6e-4605-a1f8-a59bc207a42c tempest-ProjectReaderTests-261681190 None] Lock "cinder-9e919efe-8cc6-47e9-ba9b-d2d42e288f0a-delete_snapshot" released by "delete_snapshot" :: held 2.250s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:38 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:38 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info is being set with open permissions: ugo+rw Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:38 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info Nov 05 15:22:38 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:38 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.info" returned: 0 in 0.256s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:38 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-70b708e8-aa5d-4f12-b005-6dce9d413e58 tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-c87b60b6-2086-4a1f-b1ea-609c5255c1f0-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Lock "cinder-c87b60b6-2086-4a1f-b1ea-609c5255c1f0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d2475-fad5-448e-a145-4948e6377def]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:38 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-781d6e75-2e3f-4d43-a5e4-7f69318fb3e1-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Lock "cinder-781d6e75-2e3f-4d43-a5e4-7f69318fb3e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-927756e9-e637-4df1-86f0-454daee15583" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-927756e9-e637-4df1-86f0-454daee15583" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:39 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 Nov 05 15:22:39 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 of volume 927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:39 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:39 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405fca8-6ab7-4c21-9da3-e49d30f7b277]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:39 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 Nov 05 15:22:39 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:39 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:39 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" returned: 0 in 0.494s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:22:39 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0 Nov 05 15:22:39 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:39 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" returned: 0 in 0.463s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-927756e9-e637-4df1-86f0-454daee15583(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf86ffc-b60d-4e94-83c8-6d5e1f041348]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:39 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" returned: 0 in 0.282s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-c87b60b6-2086-4a1f-b1ea-609c5255c1f0" released by "delete_volume" :: held 0.869s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:39 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 Nov 05 15:22:39 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Created reservations ['152b16bc-0ebc-4993-b03b-daf27c9fdb47', 'd4266f7f-4bc6-4403-814a-26ab92467de4', '168dfbfd-fb2b-4d83-8a05-de0e41536d80', '581d3338-bbf5-466e-8df2-60915fc0fa6b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:39 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:39 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:40 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:40 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:40 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:40 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Deleted volume successfully. Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1525c819-cc4a-48be-8b36-d27458e9e50b tempest-ProjectReaderTests-261681190 None] Lock "cinder-c87b60b6-2086-4a1f-b1ea-609c5255c1f0-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (c8608c02-6203-4a37-a319-4b993fb08a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca143c34-3932-4f60-af12-e3a82283ed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:40 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca143c34-3932-4f60-af12-e3a82283ed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037298712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317c9738-3e95-460c-a346-8ee10db23c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:41Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dece465-dd2f-4c92-ac8d-f4241e4d21af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dece465-dd2f-4c92-ac8d-f4241e4d21af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb1468f-32b4-467c-bdb9-426bcd924c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb1468f-32b4-467c-bdb9-426bcd924c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317c9738-3e95-460c-a346-8ee10db23c9e', 'volume_name': 'volume-317c9738-3e95-460c-a346-8ee10db23c9e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba3808c-f85d-4875-b0ae-17a58693b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba3808c-f85d-4875-b0ae-17a58693b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3055cc70-548f-47ac-9e90-dba2cd4148ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Volume 317c9738-3e95-460c-a346-8ee10db23c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317c9738-3e95-460c-a346-8ee10db23c9e', 'volume_size': 1} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037298712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317c9738-3e95-460c-a346-8ee10db23c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:41Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Creating volume 317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:40 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" returned: 0 in 0.553s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:40 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e 1073741824 Nov 05 15:22:40 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:40 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1 Nov 05 15:22:40 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:41 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583.781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-781d6e75-2e3f-4d43-a5e4-7f69318fb3e1" released by "_delete_snapshot" :: held 1.936s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-927756e9-e637-4df1-86f0-454daee15583" released by "delete_snapshot" :: held 1.988s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Created reservations ['1e7d96c4-7fc7-4eaf-ab51-f81eea6836bc', '5f7b2d1a-2b23-460e-808e-1336a763f071', '5af7a896-d1bf-4d2f-815f-70a39df843ea', '511c4ac2-aefb-45f3-b9bf-a5f7d559a928'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7e5382cb-03fd-41e4-a2d7-874786ac03e5 tempest-ProjectMemberTests-440827557 None] Lock "cinder-781d6e75-2e3f-4d43-a5e4-7f69318fb3e1-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:41 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e 1073741824" returned: 0 in 0.540s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:41 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e Nov 05 15:22:41 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:41 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3055cc70-548f-47ac-9e90-dba2cd4148ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317c9738-3e95-460c-a346-8ee10db23c9e', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f699af8-66ee-448b-97bb-d769556645e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Volume volume-317c9738-3e95-460c-a346-8ee10db23c9e (317c9738-3e95-460c-a346-8ee10db23c9e): created successfully Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f699af8-66ee-448b-97bb-d769556645e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (c8608c02-6203-4a37-a319-4b993fb08a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cf39e4cb-4854-4410-87b8-6d0628719141 tempest-ProjectReaderTests-261681190 None] Created volume successfully. Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-927756e9-e637-4df1-86f0-454daee15583-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Lock "cinder-927756e9-e637-4df1-86f0-454daee15583-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-927756e9-e637-4df1-86f0-454daee15583" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-927756e9-e637-4df1-86f0-454daee15583" acquired by "delete_volume" :: waited 0.026s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[df52c588-9fe4-4b86-b52e-9f4ed156cc8d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:42 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 Nov 05 15:22:42 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:42 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:42 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583 Nov 05 15:22:42 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Creating offline snapshot c2341eca-a70e-4bba-ac3d-8043b26abe7f of volume 317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[424f6828-5514-4c63-9f6f-439a465e55d6]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:43 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e Nov 05 15:22:43 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:43 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-927756e9-e637-4df1-86f0-454daee15583" returned: 0 in 0.341s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-927756e9-e637-4df1-86f0-454daee15583" released by "delete_volume" :: held 0.814s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Created reservations ['2ff6a754-370a-4ad3-97c1-29e76d7f4f1c', '18ee32df-c9b9-40ab-bc6e-33d2308b75e0', '0be7ff2d-58a4-4223-b328-58e708395de6', '381690b5-83af-4acc-8dff-e09e531794bd'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:43 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:43 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:43 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e" returned: 0 in 0.544s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:43 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f 1G Nov 05 15:22:43 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:43 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.321s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:22:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-580c987a-7c3a-4aae-b45b-2937e5205e09 tempest-ProjectMemberTests-440827557 None] Lock "cinder-927756e9-e637-4df1-86f0-454daee15583-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (caca1e29-3a6e-4777-bbd0-7d31e123f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4905ce60-38b6-4c4f-9073-63a09149c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4905ce60-38b6-4c4f-9073-63a09149c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614583501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebffc2-b368-4388-9708-ed191b013dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:44Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3d391c-dd2b-4460-afb2-cf2c38f4ec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3d391c-dd2b-4460-afb2-cf2c38f4ec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d907a1f-5bb7-418f-9471-7c8b5f445269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d907a1f-5bb7-418f-9471-7c8b5f445269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cebffc2-b368-4388-9708-ed191b013dbc', 'volume_name': 'volume-3cebffc2-b368-4388-9708-ed191b013dbc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf823364-758d-482c-978e-5baa746f68cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf823364-758d-482c-978e-5baa746f68cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b83ec9f-2a7b-488c-abc6-fbcc55a40f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:44 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:44 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Volume 3cebffc2-b368-4388-9708-ed191b013dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cebffc2-b368-4388-9708-ed191b013dbc', 'volume_size': 1} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f 1G" returned: 0 in 0.646s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317c9738-3e95-460c-a346-8ee10db23c9e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:44 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317c9738-3e95-460c-a346-8ee10db23c9e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f Nov 05 15:22:44 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:44 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317c9738-3e95-460c-a346-8ee10db23c9e -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f" returned: 0 in 0.328s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:44 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f is being set with open permissions: ugo+rw Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:44 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f Nov 05 15:22:44 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:44 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f" returned: 0 in 0.252s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:44 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:44 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info Nov 05 15:22:44 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:45 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info" returned: 0 in 0.320s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:45 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info is being set with open permissions: ugo+rw Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:45 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info Nov 05 15:22:45 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:45 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.info" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1614583501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebffc2-b368-4388-9708-ed191b013dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:44Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Creating volume 3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:45 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:45 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc 1073741824 Nov 05 15:22:45 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:45 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-00ae41cf-f592-47d9-8902-b76fc05b8bb4 tempest-ProjectReaderTests-261681190 None] Create snapshot completed successfully Nov 05 15:22:45 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc 1073741824" returned: 0 in 0.503s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:45 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:45 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc Nov 05 15:22:45 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-c2341eca-a70e-4bba-ac3d-8043b26abe7f-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-c2341eca-a70e-4bba-ac3d-8043b26abe7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-317c9738-3e95-460c-a346-8ee10db23c9e" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-317c9738-3e95-460c-a346-8ee10db23c9e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-c2341eca-a70e-4bba-ac3d-8043b26abe7f" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-c2341eca-a70e-4bba-ac3d-8043b26abe7f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Deleting offline snapshot c2341eca-a70e-4bba-ac3d-8043b26abe7f of volume 317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] snapshot_file for this snap is: volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d616f940-6924-4c07-bd34-a9c3d3f4ccd4]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:46 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc" returned: 0 in 0.314s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b83ec9f-2a7b-488c-abc6-fbcc55a40f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cebffc2-b368-4388-9708-ed191b013dbc', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bea53d1-872c-4197-b5d9-9599bba0dc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:46 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Volume volume-3cebffc2-b368-4388-9708-ed191b013dbc (3cebffc2-b368-4388-9708-ed191b013dbc): created successfully Nov 05 15:22:46 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f Nov 05 15:22:46 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bea53d1-872c-4197-b5d9-9599bba0dc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (caca1e29-3a6e-4777-bbd0-7d31e123f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:46 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1fab5048-5feb-42cf-8eec-acb579ea601d tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:22:46 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f" returned: 0 in 0.496s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-317c9738-3e95-460c-a346-8ee10db23c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762e056-6ca8-4773-88cc-4f3f626e3949]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:46 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:46 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e Nov 05 15:22:46 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:47 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e" returned: 0 in 0.440s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:47 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f Nov 05 15:22:47 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Creating offline snapshot cfea8d91-bdc2-4108-898d-1309abe8277a of volume 3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7fe56e-1f7d-476b-bdc2-a6065a1f905e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:47 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f" returned: 0 in 0.554s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:47 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc Nov 05 15:22:47 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:47 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f Nov 05 15:22:47 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Flow 'volume_create_manager' (791814e6-c727-486c-9e1d-827531a9432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0528eaff-fc72-41d8-a15f-589c1f1dd712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0528eaff-fc72-41d8-a15f-589c1f1dd712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-913209800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e51020-7dd2-47b9-8df0-632091708b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab2a8f4269b4187b80bce5133b8c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:48Z,use_quota=True,user_id='be4b45fc0edb4358a881be790273285f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bdd571-b8c3-40cc-a2e2-5772f8d52362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bdd571-b8c3-40cc-a2e2-5772f8d52362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56d04e8-81da-474e-a2a5-5bb1d75fd9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56d04e8-81da-474e-a2a5-5bb1d75fd9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e51020-7dd2-47b9-8df0-632091708b10', 'volume_name': 'volume-30e51020-7dd2-47b9-8df0-632091708b10', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24ff650-fc8f-4d84-bf90-3cd0b86ac55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:47 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f24ff650-fc8f-4d84-bf90-3cd0b86ac55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429ffbf2-675c-46b2-a2b1-94c8a54b6915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:48 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Volume 30e51020-7dd2-47b9-8df0-632091708b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e51020-7dd2-47b9-8df0-632091708b10', 'volume_size': 1} Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:48 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e.c2341eca-a70e-4bba-ac3d-8043b26abe7f" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:48 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc" returned: 0 in 0.491s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-c2341eca-a70e-4bba-ac3d-8043b26abe7f" released by "_delete_snapshot" :: held 1.957s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-317c9738-3e95-460c-a346-8ee10db23c9e" released by "delete_snapshot" :: held 1.982s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:48 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a 1G Nov 05 15:22:48 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Created reservations ['cde61703-46a7-44b3-8f3e-300a136ded7b', '3fbd208d-20c6-489d-917a-f3342463c788', '0285f767-217d-4001-9284-c09184fc2d85', '26d3bda6-5fdc-49d7-877f-ad458d9eac60'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:48 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Delete snapshot completed successfully. Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-387a74ec-969e-44c1-9253-15b0e67d92f6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-c2341eca-a70e-4bba-ac3d-8043b26abe7f-delete_snapshot" released by "delete_snapshot" :: held 2.136s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:48 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a 1G" returned: 0 in 0.408s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cebffc2-b368-4388-9708-ed191b013dbc -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:48 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cebffc2-b368-4388-9708-ed191b013dbc -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a Nov 05 15:22:48 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:48 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cebffc2-b368-4388-9708-ed191b013dbc -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a" returned: 0 in 0.279s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:48 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a is being set with open permissions: ugo+rw Nov 05 15:22:48 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:48 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a Nov 05 15:22:48 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:49 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:49 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info Nov 05 15:22:49 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:49 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-317c9738-3e95-460c-a346-8ee10db23c9e-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:49 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info is being set with open permissions: ugo+rw Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Lock "cinder-317c9738-3e95-460c-a346-8ee10db23c9e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:49 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info Nov 05 15:22:49 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-317c9738-3e95-460c-a346-8ee10db23c9e" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-317c9738-3e95-460c-a346-8ee10db23c9e" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a61881-41b5-44be-9f01-59429f7d8d7c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:49 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e Nov 05 15:22:49 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:49 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.info" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-913209800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e51020-7dd2-47b9-8df0-632091708b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab2a8f4269b4187b80bce5133b8c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:48Z,use_quota=True,user_id='be4b45fc0edb4358a881be790273285f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Creating volume 30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:49 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:49 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 1073741824 Nov 05 15:22:49 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:49 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-9868b191-74d3-42bf-b6d7-6f300d0cdc37 tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:22:49 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e" returned: 0 in 0.376s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:49 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:49 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e Nov 05 15:22:49 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:50 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 1073741824" returned: 0 in 0.461s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:50 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-317c9738-3e95-460c-a346-8ee10db23c9e" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:50 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 Nov 05 15:22:50 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-317c9738-3e95-460c-a346-8ee10db23c9e" released by "delete_volume" :: held 0.745s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Created reservations ['bf3233d9-b815-410a-9d18-f836e2b1662c', 'fd659216-02a8-42d9-acde-68d63af2719c', 'dcdb21d5-2510-481f-be49-5dd303f2e52e', '28574339-3929-4f20-af7e-3caebd392f53'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:50 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:50 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:50 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429ffbf2-675c-46b2-a2b1-94c8a54b6915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e51020-7dd2-47b9-8df0-632091708b10', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a626ad58-9af6-4ceb-a2b3-b0f84c9d8b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:50 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Volume volume-30e51020-7dd2-47b9-8df0-632091708b10 (30e51020-7dd2-47b9-8df0-632091708b10): created successfully Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a626ad58-9af6-4ceb-a2b3-b0f84c9d8b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Flow 'volume_create_manager' (791814e6-c727-486c-9e1d-827531a9432d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0358dd62-ef88-48f2-a696-d2daebfc8ddb tempest-SnapshotDependencyTests-1496700997 None] Created volume successfully. Nov 05 15:22:50 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:50 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Deleted volume successfully. Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c07a8b51-03f7-4e25-b327-8bf5230360f4 tempest-ProjectReaderTests-261681190 None] Lock "cinder-317c9738-3e95-460c-a346-8ee10db23c9e-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-cfea8d91-bdc2-4108-898d-1309abe8277a-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Lock "cinder-cfea8d91-bdc2-4108-898d-1309abe8277a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-3cebffc2-b368-4388-9708-ed191b013dbc" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-3cebffc2-b368-4388-9708-ed191b013dbc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-cfea8d91-bdc2-4108-898d-1309abe8277a" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-cfea8d91-bdc2-4108-898d-1309abe8277a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot cfea8d91-bdc2-4108-898d-1309abe8277a of volume 3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a949f7d-db35-4d74-81a1-4e52173e95d7]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:50 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a Nov 05 15:22:50 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (0ec2e2c9-a80b-418d-ad96-3abafc152441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a612067d-7b35-4792-886e-8e4ef53828b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:50 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a612067d-7b35-4792-886e-8e4ef53828b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403888967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0436010f-c749-4143-8b45-20b4d524a2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:51Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dfd9de-9749-4241-bf89-1fe3aec72123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dfd9de-9749-4241-bf89-1fe3aec72123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da216c0d-8b44-4ee2-ac65-2af7c2a307d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da216c0d-8b44-4ee2-ac65-2af7c2a307d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0436010f-c749-4143-8b45-20b4d524a2c2', 'volume_name': 'volume-0436010f-c749-4143-8b45-20b4d524a2c2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e36c5e4-3fac-43c1-b71d-672cd4b902a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e36c5e4-3fac-43c1-b71d-672cd4b902a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e59310-7436-4a7e-bc13-ae446c28c006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Volume 0436010f-c749-4143-8b45-20b4d524a2c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0436010f-c749-4143-8b45-20b4d524a2c2', 'volume_size': 1} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403888967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0436010f-c749-4143-8b45-20b4d524a2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:51Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Creating volume 0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:51 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:51 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 1073741824 Nov 05 15:22:51 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:51 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a" returned: 0 in 0.431s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cebffc2-b368-4388-9708-ed191b013dbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6782f24-6dca-4d90-81ad-e0939885d14f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:51 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc Nov 05 15:22:51 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:51 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 1073741824" returned: 0 in 0.465s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:51 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 Nov 05 15:22:51 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:51 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:51 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a Nov 05 15:22:51 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:51 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.447s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e59310-7436-4a7e-bc13-ae446c28c006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0436010f-c749-4143-8b45-20b4d524a2c2', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153cf6c3-9574-4ae1-b278-4dc65f51419a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Creating offline snapshot cfee3008-35e1-4c7a-955b-266fe87021d5 of volume 30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:51 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Volume volume-0436010f-c749-4143-8b45-20b4d524a2c2 (0436010f-c749-4143-8b45-20b4d524a2c2): created successfully Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153cf6c3-9574-4ae1-b278-4dc65f51419a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (0ec2e2c9-a80b-418d-ad96-3abafc152441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c78b9-d110-452f-913b-8ea5561769ed]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:51 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:51 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7dcd6c03-2e60-40a6-b1cf-ecdeac190685 tempest-ProjectReaderTests-261681190 None] Created volume successfully. Nov 05 15:22:51 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 Nov 05 15:22:51 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:52 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:52 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a Nov 05 15:22:52 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:52 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10" returned: 0 in 0.402s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:52 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 1G Nov 05 15:22:52 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:52 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc.cfea8d91-bdc2-4108-898d-1309abe8277a" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-cfea8d91-bdc2-4108-898d-1309abe8277a" released by "_delete_snapshot" :: held 1.606s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-3cebffc2-b368-4388-9708-ed191b013dbc" released by "delete_snapshot" :: held 1.637s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Created reservations ['aa094f5e-cb67-4b70-864a-a508db127fdb', '0da82d13-4c1b-4cad-87db-8b3ab1add870', 'e4094325-8a6f-4d03-9fe5-1475dd0792b8', '52ceb351-3f58-421f-a450-0b2f90e79f00'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:52 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-36d1d5dd-8ef4-4d55-9738-c38926a68ab1 tempest-ProjectMemberTests-440827557 None] Lock "cinder-cfea8d91-bdc2-4108-898d-1309abe8277a-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:52 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 1G" returned: 0 in 0.406s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e51020-7dd2-47b9-8df0-632091708b10 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:52 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e51020-7dd2-47b9-8df0-632091708b10 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 Nov 05 15:22:52 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-3cebffc2-b368-4388-9708-ed191b013dbc-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Lock "cinder-3cebffc2-b368-4388-9708-ed191b013dbc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-3cebffc2-b368-4388-9708-ed191b013dbc" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:52 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-3cebffc2-b368-4388-9708-ed191b013dbc" acquired by "delete_volume" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48011d-6800-4683-bc10-da5abc1414ef]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:53 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30e51020-7dd2-47b9-8df0-632091708b10 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5" returned: 0 in 0.354s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:53 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 is being set with open permissions: ugo+rw Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:53 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 Nov 05 15:22:53 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:53 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc Nov 05 15:22:53 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:53 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5" returned: 0 in 0.276s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:53 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info Nov 05 15:22:53 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:53 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc" returned: 0 in 0.422s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:53 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc Nov 05 15:22:53 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:53 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info" returned: 0 in 0.264s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:53 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info is being set with open permissions: ugo+rw Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:53 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info Nov 05 15:22:53 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:53 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-3cebffc2-b368-4388-9708-ed191b013dbc" returned: 0 in 0.258s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-3cebffc2-b368-4388-9708-ed191b013dbc" released by "delete_volume" :: held 0.762s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Created reservations ['ed40a4fe-478b-4f59-b59a-6fefaa83fea3', '037f501a-df97-41b8-a3be-ee18684c004a', '0adb3dc4-cf9f-45ad-91b9-2327124f3d0b', '8986452a-998a-4e70-945d-2596a3df5002'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:53 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.info" returned: 0 in 0.262s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:53 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:22:53 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.087s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.653s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Creating offline snapshot 5f9c833f-7149-4cfc-84c5-681f05cb6e87 of volume 0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:22:53 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-21623c74-63eb-453b-adf0-4b51f0eaae8c tempest-SnapshotDependencyTests-1496700997 None] Create snapshot completed successfully Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6961ce0-290c-42f5-841e-843455fbe94d]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:53 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:54 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 Nov 05 15:22:54 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:54 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:22:54 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-2468a1e1-e9f9-4884-acd7-b3ce364c44d4 tempest-ProjectMemberTests-440827557 None] Lock "cinder-3cebffc2-b368-4388-9708-ed191b013dbc-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:54 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2" returned: 0 in 0.412s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:54 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 1G Nov 05 15:22:54 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (639ed64b-a8c3-485a-bcc7-96353bf1e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2eebf7-a03a-4137-a5ec-8d28e50b4fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2eebf7-a03a-4137-a5ec-8d28e50b4fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883046459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d316b95-79ad-4dca-8ca2-1d6f9db80714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:55Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734be051-d305-484e-8f38-c61419fc9026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734be051-d305-484e-8f38-c61419fc9026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b609a4d9-7379-4268-a30e-b8f92b75c301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b609a4d9-7379-4268-a30e-b8f92b75c301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d316b95-79ad-4dca-8ca2-1d6f9db80714', 'volume_name': 'volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f47106-187b-49be-beee-9b49573c3d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f47106-187b-49be-beee-9b49573c3d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772b16b-3b70-40c9-84e7-965185b3c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:54 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Volume 9d316b95-79ad-4dca-8ca2-1d6f9db80714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714', 'volume_size': 1} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:54 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 1G" returned: 0 in 0.478s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:54 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0436010f-c749-4143-8b45-20b4d524a2c2 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:54 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0436010f-c749-4143-8b45-20b4d524a2c2 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 Nov 05 15:22:54 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:22:55 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Flow 'volume_create_manager' (127155cd-490b-465d-aedf-852141c67161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb8c937-0c73-421c-bccd-73f1aeffe450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0436010f-c749-4143-8b45-20b4d524a2c2 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:55 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 is being set with open permissions: ugo+rw Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb8c937-0c73-421c-bccd-73f1aeffe450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3d1c4e3-2e12-459a-8b9d-9c475e68fc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ab2a8f4269b4187b80bce5133b8c110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfee3008-35e1-4c7a-955b-266fe87021d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:55Z,use_quota=True,user_id='be4b45fc0edb4358a881be790273285f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:55 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a87a01-09b1-4b33-9a0b-56b3cc7bab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:55 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a87a01-09b1-4b33-9a0b-56b3cc7bab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4f7c26-70ed-4b7b-a69e-c70d36caa0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4f7c26-70ed-4b7b-a69e-c70d36caa0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3d1c4e3-2e12-459a-8b9d-9c475e68fc67', 'volume_name': 'volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67', 'volume_size': 1, 'snapshot_id': 'cfee3008-35e1-4c7a-955b-266fe87021d5'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0843d12c-1d58-4d04-931d-cc6c0f2dbe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0843d12c-1d58-4d04-931d-cc6c0f2dbe31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec17654-20c8-4e6b-a213-e33a3999ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:55 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Volume b3d1c4e3-2e12-459a-8b9d-9c475e68fc67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67', 'volume_size': 1, 'snapshot_id': 'cfee3008-35e1-4c7a-955b-266fe87021d5'} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:55 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:55 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info Nov 05 15:22:55 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:55 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:55 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info is being set with open permissions: ugo+rw Nov 05 15:22:55 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:55 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info Nov 05 15:22:55 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:55 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.info" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1883046459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d316b95-79ad-4dca-8ca2-1d6f9db80714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:22:55Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Creating volume 9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:56 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:56 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 1073741824 Nov 05 15:22:56 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ce58b55b-8c6e-444a-b126-f88f298e10fb tempest-ProjectReaderTests-261681190 None] Create snapshot completed successfully Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-5f9c833f-7149-4cfc-84c5-681f05cb6e87-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Lock "cinder-5f9c833f-7149-4cfc-84c5-681f05cb6e87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-0436010f-c749-4143-8b45-20b4d524a2c2" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-0436010f-c749-4143-8b45-20b4d524a2c2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-5f9c833f-7149-4cfc-84c5-681f05cb6e87" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-5f9c833f-7149-4cfc-84c5-681f05cb6e87" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Deleting offline snapshot 5f9c833f-7149-4cfc-84c5-681f05cb6e87 of volume 0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:22:56 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] snapshot_file for this snap is: volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 1073741824" returned: 0 in 0.471s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c29d51-682b-4b33-b240-d4fdc0b99750]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:56 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 Nov 05 15:22:56 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:56 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 Nov 05 15:22:56 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:56 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.520s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-quobyte-cfee3008-35e1-4c7a-955b-266fe87021d5-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" by "_create_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9772b16b-3b70-40c9-84e7-965185b3c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69106402-825b-40da-9ac3-d470def90d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-cfee3008-35e1-4c7a-955b-266fe87021d5-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Creating volume b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 from snapshot cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-quobyte-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" by "_copy_volume_from_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:56 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Volume volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 (9d316b95-79ad-4dca-8ca2-1d6f9db80714): created successfully Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69106402-825b-40da-9ac3-d470def90d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (639ed64b-a8c3-485a-bcc7-96353bf1e294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] snapshot: cfee3008-35e1-4c7a-955b-266fe87021d5, volume: b3d1c4e3-2e12-459a-8b9d-9c475e68fc67, {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 15:22:56 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-52619580-85cb-46e6-8472-2443bd3049ba tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:22:56 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87" returned: 0 in 0.426s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0436010f-c749-4143-8b45-20b4d524a2c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fce506-9c72-4d7a-9ae4-931630e1c450]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[280296ef-01f1-42b0-8912-2c5d345266ab]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:56 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:57 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 Nov 05 15:22:57 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:57 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 Nov 05 15:22:57 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:57 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5" returned: 0 in 0.392s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e51020-7dd2-47b9-8df0-632091708b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e659774-ec31-4917-87ca-46ad75452c3c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:57 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2" returned: 0 in 0.407s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:57 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 Nov 05 15:22:57 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:57 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 Nov 05 15:22:57 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:57 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Creating direct copy from snapshot {{(pid=87126) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG cinder.utils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Path /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 not found in is_blk_device check {{(pid=87126) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:57 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87" returned: 0 in 0.400s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:57 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 Nov 05 15:22:57 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:57 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87 Nov 05 15:22:57 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:57 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:58 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2.5f9c833f-7149-4cfc-84c5-681f05cb6e87" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-5f9c833f-7149-4cfc-84c5-681f05cb6e87" released by "_delete_snapshot" :: held 1.610s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-0436010f-c749-4143-8b45-20b4d524a2c2" released by "delete_snapshot" :: held 1.633s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Created reservations ['faca76cf-eaa7-4ad4-8b0a-a6d1dd78dd91', '1f84fd4d-dc6a-46ac-9350-2d90e65fc3c1', '80c351b0-c9b1-49e4-b126-2f626c511e00', '9f2c386c-0e0b-4d50-b7f5-6ff6269be26e'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:58 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Delete snapshot completed successfully. Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-39ebafaf-ba6a-45d9-bd9c-acc3e65c20d8 tempest-ProjectReaderTests-261681190 None] Lock "cinder-5f9c833f-7149-4cfc-84c5-681f05cb6e87-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-0436010f-c749-4143-8b45-20b4d524a2c2-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Lock "cinder-0436010f-c749-4143-8b45-20b4d524a2c2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-0436010f-c749-4143-8b45-20b4d524a2c2" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-0436010f-c749-4143-8b45-20b4d524a2c2" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[33818915-140b-4762-ae77-93a72a47eec1]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:22:58 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:59 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 Nov 05 15:22:59 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:59 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2" returned: 0 in 0.512s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:22:59 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2 Nov 05 15:22:59 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:22:59 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-0436010f-c749-4143-8b45-20b4d524a2c2" returned: 0 in 0.329s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-0436010f-c749-4143-8b45-20b4d524a2c2" released by "delete_volume" :: held 0.979s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Created reservations ['12cf94a2-8b63-4c33-ac00-0487dc901962', '3e4bb31b-6044-463b-a3d9-c3e2cd10417d', '7629e999-4d80-4092-8ae2-316bd80163ec', '2603b19d-bfb2-446e-b802-425bfa26daa4'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:22:59 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:00 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:00 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:00 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.504s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:00 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Deleted volume successfully. Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-85ea1cfc-b0f1-48b5-98a2-81bc4f0c9be0 tempest-ProjectReaderTests-261681190 None] Lock "cinder-0436010f-c749-4143-8b45-20b4d524a2c2-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (a703fa80-8784-455f-9cc9-fea93572d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d9eb9f-6f51-4114-a6b2-5a36658cd8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d9eb9f-6f51-4114-a6b2-5a36658cd8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285808706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabee54c-633e-4a68-814d-b46607af46cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:01Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a03fc2-b326-4270-bce5-a3b2f9dfc413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a03fc2-b326-4270-bce5-a3b2f9dfc413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31e48d4-0592-41e2-beb4-2cd997ee7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31e48d4-0592-41e2-beb4-2cd997ee7dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabee54c-633e-4a68-814d-b46607af46cb', 'volume_name': 'volume-fabee54c-633e-4a68-814d-b46607af46cb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7c488d-a7d1-4f3f-8a48-3aad518f26af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7c488d-a7d1-4f3f-8a48-3aad518f26af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428b0699-9ba3-4c0f-8c0f-45002cc937e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:00 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Volume fabee54c-633e-4a68-814d-b46607af46cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabee54c-633e-4a68-814d-b46607af46cb', 'volume_size': 1} Nov 05 15:23:00 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:04 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" returned: 0 in 6.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.image.image_utils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Image conversion details: src /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 {{(pid=87126) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 15:23:04 devstack cinder-volume[87126]: INFO cinder.image.image_utils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Converted 1024.00 MB image at 161.15 MB/s Nov 05 15:23:04 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 is being set with open permissions: ugo+rw Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:04 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 Nov 05 15:23:04 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:04 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" returned: 0 in 0.234s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" released by "_copy_volume_from_snapshot" :: held 7.485s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-cfee3008-35e1-4c7a-955b-266fe87021d5-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" released by "_create_volume_from_snapshot" :: held 7.564s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.605s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.504s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 6e539952-18e8-41f2-b691-4c7704620845 of volume 9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec17654-20c8-4e6b-a213-e33a3999ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67', 'volume_size': 1, 'snapshot_id': 'cfee3008-35e1-4c7a-955b-266fe87021d5'}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480f0be3-6735-4499-9731-5befdf5b18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e00194-9353-4764-bb4a-92e49f09731c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:04 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Volume volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 (b3d1c4e3-2e12-459a-8b9d-9c475e68fc67): created successfully Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480f0be3-6735-4499-9731-5befdf5b18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Flow 'volume_create_manager' (127155cd-490b-465d-aedf-852141c67161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:04 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-66e30f42-53e2-442e-81ff-194e94383e2c tempest-SnapshotDependencyTests-1496700997 None] Created volume successfully. Nov 05 15:23:04 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 Nov 05 15:23:04 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:04 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714" returned: 0 in 0.363s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:04 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 1G Nov 05 15:23:04 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-cfee3008-35e1-4c7a-955b-266fe87021d5-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-cfee3008-35e1-4c7a-955b-266fe87021d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-quobyte-30e51020-7dd2-47b9-8df0-632091708b10" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-30e51020-7dd2-47b9-8df0-632091708b10" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-quobyte-cfee3008-35e1-4c7a-955b-266fe87021d5" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-cfee3008-35e1-4c7a-955b-266fe87021d5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Deleting offline snapshot cfee3008-35e1-4c7a-955b-266fe87021d5 of volume 30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] snapshot_file for this snap is: volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa07158-4475-4bdc-87e3-b7957c3e12d8]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:04 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:05 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 Nov 05 15:23:05 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:05 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 1G" returned: 0 in 0.439s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:05 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 Nov 05 15:23:05 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:05 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5" returned: 0 in 0.372s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30e51020-7dd2-47b9-8df0-632091708b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d0645-3cb2-4128-a99b-5e526a839a45]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:05 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 Nov 05 15:23:05 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:05 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:05 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 is being set with open permissions: ugo+rw Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:05 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 Nov 05 15:23:05 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:05 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:05 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info Nov 05 15:23:05 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:05 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10" returned: 0 in 0.531s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:05 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:05 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 Nov 05 15:23:05 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:06 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:06 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info is being set with open permissions: ugo+rw Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:06 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info Nov 05 15:23:06 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:06 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5" returned: 0 in 0.345s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:06 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5 Nov 05 15:23:06 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:06 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.info" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.531s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285808706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabee54c-633e-4a68-814d-b46607af46cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:01Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Creating volume fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:06 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=175,cinder:INSERT=60,cinder:UPDATE=219,cinder:DELETE=20 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:23:06 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb 1073741824 Nov 05 15:23:06 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=162,cinder:INSERT=56,cinder:UPDATE=222,cinder:DELETE=17 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:23:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c252a38f-d83a-4ff5-b0be-9bed512d20c3 tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:23:06 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10.cfee3008-35e1-4c7a-955b-266fe87021d5" returned: 0 in 0.266s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-cfee3008-35e1-4c7a-955b-266fe87021d5" released by "_delete_snapshot" :: held 1.611s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-30e51020-7dd2-47b9-8df0-632091708b10" released by "delete_snapshot" :: held 1.639s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Created reservations ['a0183df2-7d8b-4727-9c48-2f381c9a65da', '3c41213a-a24e-46dd-9a97-cae196d5662b', 'dd8b98c9-6115-4721-84a5-fd90e18f0b4a', 'c111a3e5-caf0-4319-a38a-aba6de82ccf6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:06 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Delete snapshot completed successfully. Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-e5e41977-3514-42da-9957-369cb2bc5e83 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-cfee3008-35e1-4c7a-955b-266fe87021d5-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:06 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb 1073741824" returned: 0 in 0.436s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:06 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:06 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb Nov 05 15:23:06 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-30e51020-7dd2-47b9-8df0-632091708b10-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-30e51020-7dd2-47b9-8df0-632091708b10-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-quobyte-30e51020-7dd2-47b9-8df0-632091708b10" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:07 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (428b0699-9ba3-4c0f-8c0f-45002cc937e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabee54c-633e-4a68-814d-b46607af46cb', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fe6243-d5b4-423b-b858-d4ad41ccee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-30e51020-7dd2-47b9-8df0-632091708b10" acquired by "delete_volume" :: waited 0.044s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:07 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Volume volume-fabee54c-633e-4a68-814d-b46607af46cb (fabee54c-633e-4a68-814d-b46607af46cb): created successfully Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3fe6243-d5b4-423b-b858-d4ad41ccee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (a703fa80-8784-455f-9cc9-fea93572d715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9908196b-4eb7-4b19-8f45-6fed844a2397]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:07 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a390f19e-7142-4191-af9c-1ffd5616a350 tempest-ProjectReaderTests-261681190 None] Created volume successfully. Nov 05 15:23:07 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 Nov 05 15:23:07 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-6e539952-18e8-41f2-b691-4c7704620845-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Lock "cinder-6e539952-18e8-41f2-b691-4c7704620845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-9d316b95-79ad-4dca-8ca2-1d6f9db80714" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9d316b95-79ad-4dca-8ca2-1d6f9db80714" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-6e539952-18e8-41f2-b691-4c7704620845" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-6e539952-18e8-41f2-b691-4c7704620845" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 6e539952-18e8-41f2-b691-4c7704620845 of volume 9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[165cb1b9-1e89-43e1-bbec-337fa500d0de]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:07 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10" returned: 0 in 0.404s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:07 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 Nov 05 15:23:07 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:07 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10 Nov 05 15:23:07 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:07 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-30e51020-7dd2-47b9-8df0-632091708b10" returned: 0 in 0.257s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:07 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-30e51020-7dd2-47b9-8df0-632091708b10" released by "delete_volume" :: held 0.739s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845" returned: 0 in 0.381s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ca22e0-6ba4-4fb1-af84-b69c5493a85a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:07 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Created reservations ['204f1678-d6c5-434b-82ba-10fb560dbd39', '776ac945-fac1-4f43-9f1e-d22b7aee52a1', '3337c8b6-d4fc-4a65-bb94-0128a80680a9', 'e1ff2b07-e5dd-465f-969b-9f6d7436e4a2'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:08 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:08 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:08 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:08 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.316s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:08 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "cinder-quobyte-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:08 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Deleted volume successfully. Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714" returned: 0 in 0.457s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:08 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 Nov 05 15:23:08 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c5b47935-e827-4766-90ef-3197166e3ce5 tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-30e51020-7dd2-47b9-8df0-632091708b10-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3bdee6-3118-45be-af15-62237ae41ea0]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Creating offline snapshot ccd2aa24-a726-4f41-a991-9ea411be9a4d of volume fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28ab081-5401-476a-93b0-389d8158c573]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:08 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 Nov 05 15:23:08 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb Nov 05 15:23:08 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845" returned: 0 in 0.448s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:08 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845 Nov 05 15:23:08 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" returned: 0 in 0.428s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:08 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67 Nov 05 15:23:08 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:08 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb" returned: 0 in 0.397s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:08 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:09 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d 1G Nov 05 15:23:09 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:09 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714.6e539952-18e8-41f2-b691-4c7704620845" returned: 0 in 0.261s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-6e539952-18e8-41f2-b691-4c7704620845" released by "_delete_snapshot" :: held 1.658s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9d316b95-79ad-4dca-8ca2-1d6f9db80714" released by "delete_snapshot" :: held 1.682s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:09 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-quobyte-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67" released by "delete_volume" :: held 0.783s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Created reservations ['a2b1ad98-0f2e-4fee-ba68-cf296bc1ba0b', '71e0cd62-5ea2-4ce4-a66d-f3c78e0c7443', 'b2e744a4-f560-4b7b-8dcb-9d80cfcc33fe', 'c492f283-e960-473c-867b-106a8d496e77'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Created reservations ['ce773249-e5a8-47ce-8fa4-133c22311885', 'e60f46f9-c4be-4b3a-ad16-bb39645c90d5', '36a7147a-83f9-4abd-acfa-33256f9a7108', '33d6ce89-e191-4449-959e-97251cbd94d5'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0c7f2bd1-b939-4169-abf8-d65b29dc7d93 tempest-ProjectMemberTests-440827557 None] Lock "cinder-6e539952-18e8-41f2-b691-4c7704620845-delete_snapshot" released by "delete_snapshot" :: held 1.884s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:09 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:09 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:09 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d 1G" returned: 0 in 0.490s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabee54c-633e-4a68-814d-b46607af46cb -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:09 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabee54c-633e-4a68-814d-b46607af46cb -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d Nov 05 15:23:09 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-9d316b95-79ad-4dca-8ca2-1d6f9db80714-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Lock "cinder-9d316b95-79ad-4dca-8ca2-1d6f9db80714-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:09 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.336s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:09 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Deleted volume successfully. Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-9d316b95-79ad-4dca-8ca2-1d6f9db80714" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-f0514b38-f37a-495b-adc6-e3e9d60c5a6d tempest-SnapshotDependencyTests-1496700997 None] Lock "cinder-b3d1c4e3-2e12-459a-8b9d-9c475e68fc67-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9d316b95-79ad-4dca-8ca2-1d6f9db80714" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c9909e-7326-40ba-a331-d85b9a200685]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:09 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fabee54c-633e-4a68-814d-b46607af46cb -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d" returned: 0 in 0.396s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:09 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d is being set with open permissions: ugo+rw Nov 05 15:23:09 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:09 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d Nov 05 15:23:09 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:09 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 Nov 05 15:23:09 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:10 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d" returned: 0 in 0.259s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:10 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info Nov 05 15:23:10 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:10 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714" returned: 0 in 0.398s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:10 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714 Nov 05 15:23:10 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:10 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:10 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info is being set with open permissions: ugo+rw Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:10 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9d316b95-79ad-4dca-8ca2-1d6f9db80714" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:10 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info Nov 05 15:23:10 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9d316b95-79ad-4dca-8ca2-1d6f9db80714" released by "delete_volume" :: held 0.773s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Created reservations ['4f0c5e99-36a7-4762-a54a-da88b1e24ea8', 'e4d0566e-1afb-465c-a615-f62e19303819', '2e44382c-17e5-429b-8cb1-f07317fa09dd', '36b79149-a4e6-4d6d-8603-fa0a2fafd1e9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:10 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:10 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:10 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.info" returned: 0 in 0.302s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-82d16906-b5c6-470e-895b-e5c786430d94 tempest-ProjectReaderTests-261681190 None] Create snapshot completed successfully Nov 05 15:23:10 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:10 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:10 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c51cb9ae-8eba-4412-9334-a8407cea56f9 tempest-ProjectMemberTests-440827557 None] Lock "cinder-9d316b95-79ad-4dca-8ca2-1d6f9db80714-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (8a92cfec-87d8-4e15-9f0f-038f89ae1449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a406644-1c35-4016-bcce-1a51bf9aa53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a406644-1c35-4016-bcce-1a51bf9aa53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639818193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6faf001-cab9-47d8-aefc-ff80e72ec2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:11Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44461882-949d-4fcd-98c4-03fa989d4f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44461882-949d-4fcd-98c4-03fa989d4f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a461b4-1a39-4bb0-8c0a-dd8616fc8ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a461b4-1a39-4bb0-8c0a-dd8616fc8ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6faf001-cab9-47d8-aefc-ff80e72ec2d7', 'volume_name': 'volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446bef42-ddbc-4f97-99ac-9e6bf06eb66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446bef42-ddbc-4f97-99ac-9e6bf06eb66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c33a58-3175-4dfa-b5ff-b5a9f556b828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:11 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Volume e6faf001-cab9-47d8-aefc-ff80e72ec2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7', 'volume_size': 1} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639818193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6faf001-cab9-47d8-aefc-ff80e72ec2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:11Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Creating volume e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:11 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:11 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 1073741824 Nov 05 15:23:11 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-ccd2aa24-a726-4f41-a991-9ea411be9a4d-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-ccd2aa24-a726-4f41-a991-9ea411be9a4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-fabee54c-633e-4a68-814d-b46607af46cb" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-fabee54c-633e-4a68-814d-b46607af46cb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-ccd2aa24-a726-4f41-a991-9ea411be9a4d" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-ccd2aa24-a726-4f41-a991-9ea411be9a4d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Deleting offline snapshot ccd2aa24-a726-4f41-a991-9ea411be9a4d of volume fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] snapshot_file for this snap is: volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2285f4-6488-43e9-a24a-5870dd536ffb]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:11 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 1073741824" returned: 0 in 0.509s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:11 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:11 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 Nov 05 15:23:11 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:11 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d Nov 05 15:23:11 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:12 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c33a58-3175-4dfa-b5ff-b5a9f556b828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107528c7-adc1-4bdd-8984-ba60e42c7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:12 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Volume volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 (e6faf001-cab9-47d8-aefc-ff80e72ec2d7): created successfully Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107528c7-adc1-4bdd-8984-ba60e42c7b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (8a92cfec-87d8-4e15-9f0f-038f89ae1449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:12 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d" returned: 0 in 0.444s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fabee54c-633e-4a68-814d-b46607af46cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:12 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e3825447-b5c1-49f7-9077-f3374f086870 tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6610e38-a1cf-4bae-8cfd-9fb804cb06cd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:12 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb Nov 05 15:23:12 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:12 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb" returned: 0 in 0.353s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:12 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:12 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d Nov 05 15:23:12 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:13 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d" returned: 0 in 0.330s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:13 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d Nov 05 15:23:13 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:13 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb.ccd2aa24-a726-4f41-a991-9ea411be9a4d" returned: 0 in 0.275s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-ccd2aa24-a726-4f41-a991-9ea411be9a4d" released by "_delete_snapshot" :: held 1.552s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-fabee54c-633e-4a68-814d-b46607af46cb" released by "delete_snapshot" :: held 1.585s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Created reservations ['1fecf21b-d758-4023-b4f9-a84d852f9831', '19672f7f-b365-4219-b896-575efa44567d', '955a94b4-371a-4f1f-8ee8-50c098b9f82a', '6b509396-225b-4cf3-a866-807a536ddcd6'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:13 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Delete snapshot completed successfully. Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-7f5c0814-4bb7-4085-a3ca-4ec723821fc6 tempest-ProjectReaderTests-261681190 None] Lock "cinder-ccd2aa24-a726-4f41-a991-9ea411be9a4d-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 91e078b5-1fa0-4219-9ec4-92db41dc65ad of volume e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa0e29-b343-4f84-bd99-7fe87ff11c0b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:13 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 Nov 05 15:23:13 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-fabee54c-633e-4a68-814d-b46607af46cb-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:13 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Lock "cinder-fabee54c-633e-4a68-814d-b46607af46cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-fabee54c-633e-4a68-814d-b46607af46cb" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-fabee54c-633e-4a68-814d-b46607af46cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4add0e3-aa37-4cb7-95cd-b06b898899de]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:14 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" returned: 0 in 0.420s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:14 devstack sudo[108277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad 1G Nov 05 15:23:14 devstack sudo[108277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:14 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb Nov 05 15:23:14 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:14 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb" returned: 0 in 0.445s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:14 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb Nov 05 15:23:14 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:14 devstack sudo[108277]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad 1G" returned: 0 in 0.513s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:14 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad Nov 05 15:23:14 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:14 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-fabee54c-633e-4a68-814d-b46607af46cb" returned: 0 in 0.284s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-fabee54c-633e-4a68-814d-b46607af46cb" released by "delete_volume" :: held 0.825s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Created reservations ['8781ced7-0d93-41e8-9b2d-e7c0414f6778', 'd7e4e367-3d3b-4316-b8ce-e37e46834951', '0d36c01a-56cf-4374-9007-ab9f51232cf0', '76a7748e-7f21-4baa-b6ec-c98fcf861e26'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:14 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad" returned: 0 in 0.324s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:14 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad is being set with open permissions: ugo+rw Nov 05 15:23:14 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:15 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad Nov 05 15:23:15 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:15 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:15 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:15 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad" returned: 0 in 0.300s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:15 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info Nov 05 15:23:15 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:15 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:15 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Deleted volume successfully. Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd7b844c-93d7-422e-8443-1a91116bb0ef tempest-ProjectReaderTests-261681190 None] Lock "cinder-fabee54c-633e-4a68-814d-b46607af46cb-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:15 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info" returned: 0 in 0.331s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:15 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info is being set with open permissions: ugo+rw Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:15 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info Nov 05 15:23:15 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (970d6bef-adce-4292-b283-5cb290ee4b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48406c0c-e431-4e4c-97d7-45ef5c3e8f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48406c0c-e431-4e4c-97d7-45ef5c3e8f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593397183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b591413-fa0a-433c-b262-a79f9d7715d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:16Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a286fa2f-372f-4709-acf5-caa5204ba05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a286fa2f-372f-4709-acf5-caa5204ba05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be98b107-8456-4465-8cb2-b718c3b39e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be98b107-8456-4465-8cb2-b718c3b39e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b591413-fa0a-433c-b262-a79f9d7715d4', 'volume_name': 'volume-6b591413-fa0a-433c-b262-a79f9d7715d4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4633a5-1af0-4f50-bdfb-b868172ffd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4633a5-1af0-4f50-bdfb-b868172ffd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857054c6-a7c6-4faf-a8ee-ed915f749cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:15 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Volume 6b591413-fa0a-433c-b262-a79f9d7715d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b591413-fa0a-433c-b262-a79f9d7715d4', 'volume_size': 1} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:15 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.info" returned: 0 in 0.290s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.146s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1593397183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b591413-fa0a-433c-b262-a79f9d7715d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4d521ea2cc4cf490f154394dbf3c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:16Z,use_quota=True,user_id='f88dc7a2cbe64ddd947ce9defbb9eda1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Creating volume 6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:15 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:15 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:16 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 1073741824 Nov 05 15:23:16 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e8a61127-557e-4414-a451-5d03479fed0e tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:23:16 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 1073741824" returned: 0 in 0.486s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:16 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 Nov 05 15:23:16 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:16 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4" returned: 0 in 0.246s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857054c6-a7c6-4faf-a8ee-ed915f749cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b591413-fa0a-433c-b262-a79f9d7715d4', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e22f62-f160-4415-9e84-09cde9235bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:16 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Volume volume-6b591413-fa0a-433c-b262-a79f9d7715d4 (6b591413-fa0a-433c-b262-a79f9d7715d4): created successfully Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e22f62-f160-4415-9e84-09cde9235bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Flow 'volume_create_manager' (970d6bef-adce-4292-b283-5cb290ee4b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:16 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-42448e97-0828-4a8c-a495-d80016a945ef tempest-ProjectReaderTests-261681190 None] Created volume successfully. Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-91e078b5-1fa0-4219-9ec4-92db41dc65ad-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Lock "cinder-91e078b5-1fa0-4219-9ec4-92db41dc65ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-91e078b5-1fa0-4219-9ec4-92db41dc65ad" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-91e078b5-1fa0-4219-9ec4-92db41dc65ad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 91e078b5-1fa0-4219-9ec4-92db41dc65ad of volume e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[926a9d11-7630-4a59-bf3c-14ffc01d7659]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:16 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:17 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad Nov 05 15:23:17 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:17 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55c054c-9ade-4954-b7e6-a447ab7f3931]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:17 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 Nov 05 15:23:17 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:17 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" returned: 0 in 0.391s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:17 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad Nov 05 15:23:17 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:17 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Creating offline snapshot 5152be5e-fd41-4652-8fe0-fc3917977d61 of volume 6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb69f8f-01fa-4ad2-86b2-1b620fd8201c]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:18 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 Nov 05 15:23:18 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:18 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad" returned: 0 in 0.467s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:18 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad Nov 05 15:23:18 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:18 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4" returned: 0 in 0.451s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:18 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 1G Nov 05 15:23:18 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:18 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7.91e078b5-1fa0-4219-9ec4-92db41dc65ad" returned: 0 in 0.288s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-91e078b5-1fa0-4219-9ec4-92db41dc65ad" released by "_delete_snapshot" :: held 1.654s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" released by "delete_snapshot" :: held 1.677s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Created reservations ['e636f17f-532a-454e-a83c-71de9458892a', 'c4400791-7d69-44f7-b6a4-f43526965841', '02a95c59-3867-4fab-a651-ce409ad3539d', 'ef4c3282-6d18-497e-bbb4-1bcec10cfca8'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:18 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-324c4243-1e78-435d-96cc-f47dc9b68d2b tempest-ProjectMemberTests-440827557 None] Lock "cinder-91e078b5-1fa0-4219-9ec4-92db41dc65ad-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:18 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 1G" returned: 0 in 0.466s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:18 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b591413-fa0a-433c-b262-a79f9d7715d4 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:18 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b591413-fa0a-433c-b262-a79f9d7715d4 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 Nov 05 15:23:18 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-e6faf001-cab9-47d8-aefc-ff80e72ec2d7-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Lock "cinder-e6faf001-cab9-47d8-aefc-ff80e72ec2d7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddb5fd2-12e3-497b-aa84-4dfa632aa332]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:19 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b591413-fa0a-433c-b262-a79f9d7715d4 -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61" returned: 0 in 0.401s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:19 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 is being set with open permissions: ugo+rw Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:19 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 Nov 05 15:23:19 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:19 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 Nov 05 15:23:19 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:19 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61" returned: 0 in 0.285s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:19 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" returned: 0 in 0.450s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:19 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info Nov 05 15:23:19 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:19 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7 Nov 05 15:23:19 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:19 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:19 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" returned: 0 in 0.267s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info" returned: 0 in 0.307s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:19 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info is being set with open permissions: ugo+rw Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:19 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-e6faf001-cab9-47d8-aefc-ff80e72ec2d7" released by "delete_volume" :: held 0.818s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:20 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info Nov 05 15:23:20 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Created reservations ['6f22fce6-7afb-45c2-b580-14ded913c497', 'f0ef5cf2-e02d-494b-b843-fb0a3e77eb43', '8f97fde8-d922-4c51-904d-184a66a8697b', '02bf622f-84c4-491b-9b6e-f00582305960'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:20 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:20 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:20 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.info" returned: 0 in 0.293s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-e5f288b8-ee52-40e1-8bda-aedbb7e49cb5 tempest-ProjectReaderTests-261681190 None] Create snapshot completed successfully Nov 05 15:23:20 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.291s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:20 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-acd99441-c256-48bc-a5e0-8ee6d0ec9802 tempest-ProjectMemberTests-440827557 None] Lock "cinder-e6faf001-cab9-47d8-aefc-ff80e72ec2d7-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (8c362552-9a78-4026-89bd-d259bbe9d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464a003e-e85f-4b2a-8a82-c5156e156494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464a003e-e85f-4b2a-8a82-c5156e156494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418001607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:21Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216a3b3d-4ef4-45d5-bf9b-03c5f4bdef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216a3b3d-4ef4-45d5-bf9b-03c5f4bdef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427a79bd-d14d-44bc-bd0e-218deb04762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427a79bd-d14d-44bc-bd0e-218deb04762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b', 'volume_name': 'volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807ee9d-a8ca-4ea4-ac81-6e874f0ceeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807ee9d-a8ca-4ea4-ac81-6e874f0ceeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de893aa3-8d77-474d-b311-16473a30662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:20 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Volume b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b', 'volume_size': 1} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418001607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:21Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Creating volume b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:20 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:20 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:20 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b 1073741824 Nov 05 15:23:20 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-5152be5e-fd41-4652-8fe0-fc3917977d61-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Lock "cinder-5152be5e-fd41-4652-8fe0-fc3917977d61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-6b591413-fa0a-433c-b262-a79f9d7715d4" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-6b591413-fa0a-433c-b262-a79f9d7715d4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-5152be5e-fd41-4652-8fe0-fc3917977d61" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-5152be5e-fd41-4652-8fe0-fc3917977d61" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Deleting offline snapshot 5152be5e-fd41-4652-8fe0-fc3917977d61 of volume 6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] snapshot_file for this snap is: volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaba289-ae8b-4638-a6a9-0db58bcacd02]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:21 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 Nov 05 15:23:21 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:21 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b 1073741824" returned: 0 in 0.523s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:21 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b Nov 05 15:23:21 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:21 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61" returned: 0 in 0.378s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b591413-fa0a-433c-b262-a79f9d7715d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4727c3-3c8d-48ef-838f-bc8388ce574b]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:21 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de893aa3-8d77-474d-b311-16473a30662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf922d64-75c6-4114-b1c6-37db63495628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:21 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Volume volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b (b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b): created successfully Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf922d64-75c6-4114-b1c6-37db63495628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (8c362552-9a78-4026-89bd-d259bbe9d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:21 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-8d0ade46-64ef-4ca8-ade1-cde6668f79cf tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:23:21 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 Nov 05 15:23:21 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:21 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:21 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4" returned: 0 in 0.359s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:22 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 Nov 05 15:23:22 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:22 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61" returned: 0 in 0.318s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:22 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61 Nov 05 15:23:22 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:22 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4.5152be5e-fd41-4652-8fe0-fc3917977d61" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-5152be5e-fd41-4652-8fe0-fc3917977d61" released by "_delete_snapshot" :: held 1.392s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-6b591413-fa0a-433c-b262-a79f9d7715d4" released by "delete_snapshot" :: held 1.419s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Created reservations ['785b79f9-7170-4667-8d95-53326b7e2f22', 'c4c41794-cdfc-43bc-9ee5-b8f2db997556', '387a3e8e-5f0a-420b-b537-d9b4e8c75442', '61e7b193-de3c-4241-a99e-cb436b0d4842'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:22 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Delete snapshot completed successfully. Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-ec52057d-9ae2-433f-a809-882dcf63f200 tempest-ProjectReaderTests-261681190 None] Lock "cinder-5152be5e-fd41-4652-8fe0-fc3917977d61-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 652fa856-9e43-46ef-9d0f-3408f8ee6611 of volume b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[838694d7-c71f-4b81-9182-8a43f0b2997a]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:22 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:23 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b Nov 05 15:23:23 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-6b591413-fa0a-433c-b262-a79f9d7715d4-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Lock "cinder-6b591413-fa0a-433c-b262-a79f9d7715d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Acquiring lock "cinder-quobyte-6b591413-fa0a-433c-b262-a79f9d7715d4" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-6b591413-fa0a-433c-b262-a79f9d7715d4" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:23 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f09c6-0f1a-4520-a216-1f25b5524548]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:23 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 1G Nov 05 15:23:23 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:23 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 Nov 05 15:23:23 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:23 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 1G" returned: 0 in 0.389s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:23 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4" returned: 0 in 0.386s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:23 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:23 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 Nov 05 15:23:23 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:23 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4 Nov 05 15:23:23 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:24 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-6b591413-fa0a-433c-b262-a79f9d7715d4" returned: 0 in 0.254s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Lock "cinder-quobyte-6b591413-fa0a-433c-b262-a79f9d7715d4" released by "delete_volume" :: held 0.716s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:24 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611" returned: 0 in 0.309s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 is being set with open permissions: ugo+rw Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:24 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 Nov 05 15:23:24 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Created reservations ['54887452-f727-40ee-a4e5-55d3a07cd191', 'cfbd15e3-572d-42f2-9c8e-8bcfab9b6bb9', '3b53aeb0-a05f-4664-9d7a-7465bf141ee5', '7a874ead-adc3-45d7-861b-9a947436a4d9'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:24 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:24 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:24 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:24 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info Nov 05 15:23:24 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:24 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.265s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Deleted volume successfully. Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-c54cb578-23ee-4d7f-a5f5-a7e3f675ca42 tempest-ProjectReaderTests-261681190 None] Lock "cinder-6b591413-fa0a-433c-b262-a79f9d7715d4-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:24 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info" returned: 0 in 0.263s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:24 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info is being set with open permissions: ugo+rw Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:24 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info Nov 05 15:23:24 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:24 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.info" returned: 0 in 0.248s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:24 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.964s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:24 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-f9ac8981-3cca-4e01-bd75-84b56d1ee570 tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-652fa856-9e43-46ef-9d0f-3408f8ee6611-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Lock "cinder-652fa856-9e43-46ef-9d0f-3408f8ee6611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-652fa856-9e43-46ef-9d0f-3408f8ee6611" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-652fa856-9e43-46ef-9d0f-3408f8ee6611" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 652fa856-9e43-46ef-9d0f-3408f8ee6611 of volume b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4195773a-4bf0-4b27-8da7-7fa7243a8f9e]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:25 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 Nov 05 15:23:25 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:25 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611" returned: 0 in 0.419s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc53460d-e93f-4cb4-ad50-57f5ca1b4837]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:25 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:25 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b Nov 05 15:23:25 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:26 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" returned: 0 in 0.384s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:26 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 Nov 05 15:23:26 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:26 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611" returned: 0 in 0.364s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:26 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611 Nov 05 15:23:26 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:26 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b.652fa856-9e43-46ef-9d0f-3408f8ee6611" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-652fa856-9e43-46ef-9d0f-3408f8ee6611" released by "_delete_snapshot" :: held 1.556s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" released by "delete_snapshot" :: held 1.578s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Created reservations ['8461034c-4498-4a56-b000-4bb1879eb0fd', '040e2d00-cb23-47ac-9e5f-180f6173a9e2', '6f21ef7c-eafa-47b6-9eaa-104197356ea2', 'e87e6fc7-866b-4905-8e46-3503a506ad2b'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:26 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:23:26 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-a69d9ae8-bba4-4c23-83cd-fb6815f91e3b tempest-ProjectMemberTests-440827557 None] Lock "cinder-652fa856-9e43-46ef-9d0f-3408f8ee6611-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Lock "cinder-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" acquired by "delete_volume" :: waited 0.025s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[4147c06f-0fab-4995-809e-661240ec3203]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:27 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b Nov 05 15:23:27 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:27 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" returned: 0 in 0.390s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:27 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:27 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b Nov 05 15:23:27 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:28 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" returned: 0 in 0.260s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b" released by "delete_volume" :: held 0.731s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Created reservations ['4cd2f0cc-1357-4fdd-ab28-95b9dcd15fb0', 'f978d6c2-6f3b-43d0-8e25-59bb9c486c68', '95c2d002-9897-4b0a-8469-ab32df5f26ee', 'f1c9ceeb-d41f-421f-86ae-fee1d18decdb'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:28 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:28 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:28 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.269s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:28 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-1de2004c-df79-4182-bcb2-2e58a2acfb37 tempest-ProjectMemberTests-440827557 None] Lock "cinder-b9ec7cb4-c5ab-4218-8cb8-ed038fd8fe7b-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:28 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (bc18f690-42f0-427f-abac-aa47550720d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e75dc7-c484-4ba1-a08a-b4ebd1aea53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e75dc7-c484-4ba1-a08a-b4ebd1aea53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136451308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af4b1a4-fbe5-4934-9b77-779711b49b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:29Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e5a1eb-576f-4931-a5dd-63de2adec380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e5a1eb-576f-4931-a5dd-63de2adec380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ba87ad-bb6c-423f-841b-2b9475fcc00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ba87ad-bb6c-423f-841b-2b9475fcc00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af4b1a4-fbe5-4934-9b77-779711b49b0f', 'volume_name': 'volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5c5904-93ac-45b7-9930-ac2c00e306dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d5c5904-93ac-45b7-9930-ac2c00e306dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc1da44-1b17-41dc-846c-fcaa2dccf57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Volume 9af4b1a4-fbe5-4934-9b77-779711b49b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f', 'volume_size': 1} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2136451308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af4b1a4-fbe5-4934-9b77-779711b49b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe51fef6a5543a7b9e362028fd47f77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:29Z,use_quota=True,user_id='b19d14f8b2ac4cd19f4c1c7214850dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Creating volume 9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:29 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:29 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f 1073741824 Nov 05 15:23:29 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:29 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f 1073741824" returned: 0 in 0.443s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:29 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f Nov 05 15:23:29 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:29 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc1da44-1b17-41dc-846c-fcaa2dccf57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c0498d-c723-483f-bcf8-fdaddf041cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:29 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Volume volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f (9af4b1a4-fbe5-4934-9b77-779711b49b0f): created successfully Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c0498d-c723-483f-bcf8-fdaddf041cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:29 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Flow 'volume_create_manager' (bc18f690-42f0-427f-abac-aa47550720d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:29 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-37596c79-6104-4aed-8522-bd0337732597 tempest-ProjectMemberTests-440827557 None] Created volume successfully. Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Creating offline snapshot 92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc of volume 9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1ace67-fbb1-4e53-a2cd-511e606a2ebd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:30 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f Nov 05 15:23:30 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:30 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f" returned: 0 in 0.382s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc 1G {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:30 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc 1G Nov 05 15:23:30 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:30 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc 1G" returned: 0 in 0.383s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:30 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:30 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc Nov 05 15:23:30 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:31 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f -F qcow2 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" returned: 0 in 0.278s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:31 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc is being set with open permissions: ugo+rw Nov 05 15:23:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:31 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc Nov 05 15:23:31 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:31 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" returned: 0 in 0.250s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:31 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info Nov 05 15:23:31 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:31 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info" returned: 0 in 0.255s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:31 devstack cinder-volume[87126]: WARNING cinder.volume.drivers.remotefs [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info is being set with open permissions: ugo+rw Nov 05 15:23:31 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:31 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info Nov 05 15:23:31 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:32 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.info" returned: 0 in 0.243s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:32 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-56e999b6-152e-42f2-8a08-5b9d524180e9 tempest-ProjectMemberTests-440827557 None] Create snapshot completed successfully Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc-delete_snapshot" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Lock "cinder-92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-9af4b1a4-fbe5-4934-9b77-779711b49b0f" by "delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9af4b1a4-fbe5-4934-9b77-779711b49b0f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" by "_delete_snapshot" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Deleting offline snapshot 92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc of volume 9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] snapshot_file for this snap is: volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc {{(pid=87126) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3b7b9c-a6b3-40de-b429-8ccffdbb56ef]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:32 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc Nov 05 15:23:32 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:32 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" returned: 0 in 0.347s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87126) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bb3f65-e30f-4259-9711-a91295529f78]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:32 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:32 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f Nov 05 15:23:32 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:33 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f" returned: 0 in 0.344s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:33 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc Nov 05 15:23:33 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:33 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" returned: 0 in 0.326s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:33 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc Nov 05 15:23:33 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:33 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f.92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" returned: 0 in 0.242s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc" released by "_delete_snapshot" :: held 1.359s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9af4b1a4-fbe5-4934-9b77-779711b49b0f" released by "delete_snapshot" :: held 1.382s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Created reservations ['dfcf1612-dae8-4b51-a14b-d6c9b4315402', 'f7c58c6b-904c-4809-8011-384bd3428d20', '79f97d29-23ee-4765-85cc-a6d2ff503b6f', '34c52259-4a5e-4f7d-baff-d5bd2bf12943'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:33 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Delete snapshot completed successfully. Nov 05 15:23:33 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-cce88c13-6c79-4682-99d1-c15f01a118cb tempest-ProjectMemberTests-440827557 None] Lock "cinder-92aeba3d-aea5-4fdc-81c3-41a4fdfc15dc-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-9af4b1a4-fbe5-4934-9b77-779711b49b0f-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Lock "cinder-9af4b1a4-fbe5-4934-9b77-779711b49b0f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Acquiring lock "cinder-quobyte-9af4b1a4-fbe5-4934-9b77-779711b49b0f" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:34 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9af4b1a4-fbe5-4934-9b77-779711b49b0f" acquired by "delete_volume" :: waited 0.016s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:34 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef3ec6-8329-4ebe-9b45-661e1a8e2bdd]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:34 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:34 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f Nov 05 15:23:34 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:35 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f" returned: 0 in 0.349s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:35 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f Nov 05 15:23:35 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:35 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-9af4b1a4-fbe5-4934-9b77-779711b49b0f" returned: 0 in 0.251s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Lock "cinder-quobyte-9af4b1a4-fbe5-4934-9b77-779711b49b0f" released by "delete_volume" :: held 0.657s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Created reservations ['541876cd-d5bd-401a-8761-02e7e216ce3d', '069d2a44-ee71-461d-ba6d-ccd14e6cecbb', '9fd77d8f-5d30-422d-94ea-4a20c9eaf130', 'b045753f-e651-47b3-9c69-3c58d95e71bf'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:35 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:35 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:35 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:35 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Deleted volume successfully. Nov 05 15:23:35 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-541e910a-4965-4057-a1a2-903d6e41dec0 tempest-ProjectMemberTests-440827557 None] Lock "cinder-9af4b1a4-fbe5-4934-9b77-779711b49b0f-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:39 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:39 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Flow 'volume_create_manager' (fff81f0b-5a81-4f7c-8996-3031b0e23446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7397c35-8b7c-483d-be5d-b083ae207134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7397c35-8b7c-483d-be5d-b083ae207134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443764307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90655a7-ecc8-4358-9f16-7cfed19de51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810c9e7bd7104accaa8fe8ebf3cdee3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:39Z,use_quota=True,user_id='9527d53a0a4e4739946af3a20e85987e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201936b6-4f7b-4e9f-b23f-4b7a2f3d39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201936b6-4f7b-4e9f-b23f-4b7a2f3d39ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e851ae-574a-4b7d-afd7-e0dfdfbace67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e851ae-574a-4b7d-afd7-e0dfdfbace67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90655a7-ecc8-4358-9f16-7cfed19de51b', 'volume_name': 'volume-d90655a7-ecc8-4358-9f16-7cfed19de51b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05647b30-3b29-4804-b16a-8765e84880ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05647b30-3b29-4804-b16a-8765e84880ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15166c8d-47bc-4a3b-898a-dd5e6ac9d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:39 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Volume d90655a7-ecc8-4358-9f16-7cfed19de51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90655a7-ecc8-4358-9f16-7cfed19de51b', 'volume_size': 1} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443764307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90655a7-ecc8-4358-9f16-7cfed19de51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810c9e7bd7104accaa8fe8ebf3cdee3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:39Z,use_quota=True,user_id='9527d53a0a4e4739946af3a20e85987e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Creating volume d90655a7-ecc8-4358-9f16-7cfed19de51b {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:39 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:39 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b 1073741824 Nov 05 15:23:39 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:39 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.271s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_service.periodic_task [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] Running periodic task VolumeManager._thread_info {{(pid=87126) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread count: 28 {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-5eedd656-1f1f-4a25-bc23-b92cce186133 None None] thread info: [<_MainThread(MainThread, started 127298724917376)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87126) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 05 15:23:39 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b 1073741824" returned: 0 in 0.425s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:39 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b Nov 05 15:23:39 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:39 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b" returned: 0 in 0.239s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:39 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15166c8d-47bc-4a3b-898a-dd5e6ac9d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90655a7-ecc8-4358-9f16-7cfed19de51b', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59a5fd1-7350-450d-a9b6-0fe79faa295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:40 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Volume volume-d90655a7-ecc8-4358-9f16-7cfed19de51b (d90655a7-ecc8-4358-9f16-7cfed19de51b): created successfully Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59a5fd1-7350-450d-a9b6-0fe79faa295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Flow 'volume_create_manager' (fff81f0b-5a81-4f7c-8996-3031b0e23446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:40 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-c0001851-beab-4030-8e6c-233c93cb8ef1 tempest-ProjectReaderTests-2034943366 None] Created volume successfully. Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "cinder-d90655a7-ecc8-4358-9f16-7cfed19de51b-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-d90655a7-ecc8-4358-9f16-7cfed19de51b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "cinder-quobyte-d90655a7-ecc8-4358-9f16-7cfed19de51b" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-quobyte-d90655a7-ecc8-4358-9f16-7cfed19de51b" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[421428fa-58ca-4c24-b4ea-ac691965362f]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:40 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b Nov 05 15:23:40 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:40 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b" returned: 0 in 0.367s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:40 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:40 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b Nov 05 15:23:40 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:41 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-d90655a7-ecc8-4358-9f16-7cfed19de51b" returned: 0 in 0.238s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-quobyte-d90655a7-ecc8-4358-9f16-7cfed19de51b" released by "delete_volume" :: held 0.643s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Created reservations ['cf3de092-e6dc-4ba3-8c71-a28f18a1b824', '0aec984c-bc15-4397-9a8e-d60d73ffddf6', 'e9a145e2-67bc-482f-b8b1-1f3f804cd2bd', '73fb0552-3488-4c29-9916-23c5f84e0d71'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:41 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:41 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:41 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.245s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:41 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Deleted volume successfully. Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-dd8bed6a-9c07-47ec-84e2-74b3cce83f02 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-d90655a7-ecc8-4358-9f16-7cfed19de51b-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87126) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Flow 'volume_create_manager' (487c9195-c21d-4400-b2ee-c64928371c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313343a1-d991-40e4-aabf-b8119e6b7e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313343a1-d991-40e4-aabf-b8119e6b7e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626890229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9570a0e-94a6-4fa8-be67-0e53a3840e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810c9e7bd7104accaa8fe8ebf3cdee3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:42Z,use_quota=True,user_id='9527d53a0a4e4739946af3a20e85987e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4d9f44-337c-4810-b25d-441f724a346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4d9f44-337c-4810-b25d-441f724a346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e91e6e-e23e-4da7-831f-587ab8805ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e91e6e-e23e-4da7-831f-587ab8805ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9570a0e-94a6-4fa8-be67-0e53a3840e24', 'volume_name': 'volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a03ab9-1ca3-478e-ac08-c3c80892c2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a03ab9-1ca3-478e-ac08-c3c80892c2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0d8997-8136-43ea-934f-6eb3396f588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:41 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Volume f9570a0e-94a6-4fa8-be67-0e53a3840e24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24', 'volume_size': 1} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T14:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-626890229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9570a0e-94a6-4fa8-be67-0e53a3840e24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810c9e7bd7104accaa8fe8ebf3cdee3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T14:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T14:23:42Z,use_quota=True,user_id='9527d53a0a4e4739946af3a20e85987e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de501d6a-42b7-479d-a750-e2d014d7c3e0),volume_type_id=de501d6a-42b7-479d-a750-e2d014d7c3e0)}" {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.remotefs [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Creating volume f9570a0e-94a6-4fa8-be67-0e53a3840e24 {{(pid=87126) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:41 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Selected osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d as target Quobyte volume. {{(pid=87126) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 15:23:42 devstack cinder-volume[87126]: INFO cinder.volume.drivers.remotefs [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] casted to osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 1073741824 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:42 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 1073741824 Nov 05 15:23:42 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:42 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 1073741824" returned: 0 in 0.409s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:42 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 Nov 05 15:23:42 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:42 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24" returned: 0 in 0.241s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'} {{(pid=87126) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc0d8997-8136-43ea-934f-6eb3396f588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24', 'volume_size': 1}' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59347135-2080-4f20-b0c9-cc7811e14072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 15:23:42 devstack cinder-volume[87126]: INFO cinder.volume.flows.manager.create_volume [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Volume volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 (f9570a0e-94a6-4fa8-be67-0e53a3840e24): created successfully Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59347135-2080-4f20-b0c9-cc7811e14072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87126) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Flow 'volume_create_manager' (487c9195-c21d-4400-b2ee-c64928371c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87126) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 15:23:42 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-1d06fefc-f4a9-4091-ae9f-72e584b0569d tempest-ProjectReaderTests-2034943366 None] Created volume successfully. Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "cinder-f9570a0e-94a6-4fa8-be67-0e53a3840e24-delete_volume" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:42 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-f9570a0e-94a6-4fa8-be67-0e53a3840e24-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "cinder-quobyte-f9570a0e-94a6-4fa8-be67-0e53a3840e24" by "delete_volume" {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-quobyte-f9570a0e-94a6-4fa8-be67-0e53a3840e24" acquired by "delete_volume" :: waited 0.015s {{(pid=87126) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c4a761-c247-4e5a-91c1-f70288a60470]: (4, 'qcow2') {{(pid=88823) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:43 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 Nov 05 15:23:43 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:43 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24" returned: 0 in 0.348s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:43 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24 Nov 05 15:23:43 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:43 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6/volume-f9570a0e-94a6-4fa8-be67-0e53a3840e24" returned: 0 in 0.229s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-quobyte-f9570a0e-94a6-4fa8-be67-0e53a3840e24" released by "delete_volume" :: held 0.617s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.quota [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Created reservations ['accdbc2e-40b8-4f32-9528-eeba0fde967d', '9500385d-c50b-410b-8a36-4938a156c283', 'f342bd52-4bfc-4166-a841-47662c186610', '5e947944-b414-420d-8371-9ac0b6a04b14'] {{(pid=87126) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d': None} {{(pid=87126) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.volume.drivers.quobyte [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fa693b82-ba0d-4d8e-9c34-5dc93269758d'] {{(pid=87126) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.lockutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87126) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 15:23:43 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6 Nov 05 15:23:43 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 15:23:43 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG oslo_concurrency.processutils [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b64173e89f528798a5b34a12c12d16d6" returned: 0 in 0.240s {{(pid=87126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 15:23:43 devstack cinder-volume[87126]: DEBUG cinder.manager [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Notifying Schedulers of capabilities ... {{(pid=87126) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 15:23:43 devstack cinder-volume[87126]: INFO cinder.volume.manager [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Deleted volume successfully. Nov 05 15:23:44 devstack cinder-volume[87126]: DEBUG cinder.coordination [None req-0670a9a7-6170-4a7d-a141-d073228130d6 tempest-ProjectReaderTests-2034943366 None] Lock "cinder-f9570a0e-94a6-4fa8-be67-0e53a3840e24-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87126) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 15:23:53 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:SELECT=113,cinder:INSERT=40,cinder:UPDATE=141,cinder:DELETE=10 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 15:23:54 devstack cinder-volume[87126]: DEBUG dbcounter [-] [87126] Writing DB stats cinder:DELETE=13,cinder:SELECT=103,cinder:INSERT=40,cinder:UPDATE=152 {{(pid=87126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}